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From Our Briefcase 

















GAO Executive 
Acclaimed for Good 
Management Style 


“It’s hard for most people who 
know [him] to describe his negative 
qualities. Though they say he must 
have some, they really can’t think of 
any.” This laudatory assessment of 
the General Government Division’s 
director Bill Anderson appeared in 
the December 1981 issue of Govern- 
ment Executive. The article spot- 
lights Anderson as an innovative 
manager whose equal dedication to 
subject matter and staff makes him 
exceptional. 

Citing praise from colleagues, the 
article describes Anderson’s people- 
oriented management style. It also 
reviews his career at GAO and his 


1 


many contributions to effective gov- 
ernment. The article concludes that 
“Anderson’s style is just downright 
approachable, whether it be with 
people or the thoughts people have. 
He shares all his knowledge and 
asks his staff to do the same. The 
game is learning how to trade and 
compare this knowledge.” 

The Government Executive is 
available in GAO’s technical library. 


Governmental 
Accounting 


The final report of the Govern- 
mental Accounting Standards Board 
Organization Committee, as unani- 
mously adopted and submitted to 
the Financial Accounting Founda- 
tion in October 1981, was released 
to the public in mid-December. 
Highlights of results include 
© anew five-member Governmental 
Accounting Standards Board 
(GASB), to function similarly to but 
separately from the Financial Ac- 
counting Standards Board, with 
both boards under Financial Ac- 
counting Foundation oversight; 

e additional Foundation trustees, 
representing governmental groups; 
¢ a new 15-member governmental 
consulting and review group, inter- 
acting with GASB in much the same 
manner as the present Advisory 
Council does with the Financial Ac- 
counting Standards Board; 

¢ GASB to set financial accounting 
standards for all State and local 


governmental units except those 
that are similar to corresponding 
privately owned entities (e.g., 
hospitals and utilities); GASB and 
the Financial Accounting Standards 
Board would jointly issue standards 
for government entities of the latter 
type. 

The committee’s conclusions fo- 
cus on structural issues, leaving to 
the Foundation the operating de- 
tails. Shortly after receiving the 
report, the Foundation moved to 
create an advisory implementing 
committee, of which Comptroller 
General Bowsher is a member. 


Activities for GAO’s 
Over-40 Population 


Equal Employment Opportunity 
and Merit Promotion, two programs 
covered by GAO orders, provide the 
basis for GAO’s policy regarding 
employment of persons age 40 and 
above. From the prohibition of age 
discrimination in employment and 
in selection for job vacancies, other 
policies and practices evolve. For in- 
stance, older employees are _ in- 
cluded in opportunities for training, 
both in-house and outside the 
agency, to enhance their effec- 
tiveness and opportunities for ad- 
vancement. 

As of October 15, 1981, 1,687 per- 
sons age 40 and older (33.2 percent 
of our work force) were on GAO’s 
rolls. Although employees in this 
age group participate widely in all 
Our programs, most notably we have 
three employees age 40 and older in 
the Upward Mobility Program. (This 
program usually draws participants 
from a younger population.) 

GAO’s Labor Management and 
Employee Relations (LMER) Branch 
arranges the Employee Health Main- 
tenance Examination, a comprehen- 
sive and professional medical 
examination available on a 2-year 
cycle for all employees age 40 and 
older. LMER also offers individual 
preretirement counseling to employ- 
ees nearing retirement age. The 
Office of Organization and Human 
Development provides semiannual 
preretirement seminars for these 
employees. Our Civil Rights Office 
can offer information and advice on 
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complaints of alleged age discrimi- 
nation. 

Since November 1980, GAO has 
published 31 reports dealing with 
Federal issues affecting the elderly. 
As of December 1981, 39 audit 
surveys and reviews relating to the 
elderly were in process. For a list of 
published reports and audits under- 
way, contact Dan Brier of the Hu- 
man Resources Division at 755-5450. 


Public Administration 
Information Sources 


The practice of bureaucratic 
skills at all levels of government is 
one in which Americans have 
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achieved a high degree of compe- 
tence. Encompassing a large variety 
of current concerns, the literature of 
public administration originates 
from political science, history, psy- 
chology, business, management, so- 
ciology, social work, and econom- 
ics. Public Administration in Ameri- 
can Society: A Guide to Information 
Sources is an annotated bibliogra- 
phy of some 1,700 publications that 
will help the college-level student, 
teacher, and bureaucrat. 

Including works from many disci- 
plines, Public Administration in 
American Society is arranged in 
seven major chapters covering 
these areas of interest: Federalism 
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and administrative structure, pol- 
itics and the administrative process, 
the discipline and practice of public 
administration, organizational ac- 
tions and their effects, public per- 
sonnel administration, and govern- 
mental discrimination and equal 
employment. 

Within each chapter, entries are 
further subdivided into appropriate 
topical categories. Locating spe- 
cific items in the bibliography is 
helped by three indexes: author, ti- 
tle, and subject. (This review was 
adapted from the Public Administra- 
tion Times, Vol. 4, No. 1.) 





On Loeation 


U.S. Comptrollers 
General Figure in 
National Contract 
Management 
Association Award 
Program 


Former Comptroller General 
Elmer B. Staats won the fourth 
Herbert Roback Memorial Award in 
November 1981. This honor, be- 
stowed annually by the Washington 
Chapter of the National Contract 
Management Association, recog- 
nizes a distinguished American who 
has made a significant contribution 
to the betterment of public contract 
management. 

The award program’s speaker, 
Comptroller General Charles aA. 
Bowsher, addressed the audience 
on “Reforms in Procurement: The 
GAO Perspective.” The Comptroller 
General applauded the Office of 
Federal Procurement Policy’s ef- 
forts in developing a proposed com- 
prehensive plan to resolve serious 
and persistent Federal procurement 
problems. The plan’s key reforms in- 
clude 
¢ modifying, eliminating, and sim- 
plifying procurement laws and regu- 
lations, 
e¢ improving organization and man- 
agement systems to enhance ac- 
countability and control over the 
procurement process, 

e fostering increased competition 
and encouraging innovations in 
satisfying the Government’s needs 
for goods and services, and 

e developing a high quality work 
force. 

Comptroller General Bowsher 
also discussed GAO’s views on ini- 
tiatives to reform the defense ac- 
quisition process. He reiterated 
GAO’s support for multiyear con- 
tracting and expressed opposition 
to the Defense Department’s recom: 
mendation to amend or repeal the 
cost accounting standard on 
“depreciation of tangible (capital) 
assets” without considering other 
related cost accounting standards. 
Mr. Bowsher concluded with his as- 
surance that improvements to the 
Federal procurement system would 





be one of GAO’s highest priorities 
during his term of office. 


Bowsher Addresses 
Budget and Program 
Analysis Symposium 


Last November, budget and 
analysis professionals met at a 
symposium on “Making Govern- 
ment Management Work Better,” 
held at George Washington Univer- 
sity. Convened by the American 
Association for Budget and Pro- 
gram Analysis (AABPA), the sym- 
posium was addressed by Comp- 
troller General Charles Bowsher, 
Tom Kramer, a senior congressional 
staff member representing Senator 
William Roth, and Washington Post 
journalist Mike Causey. 


Comptroller General Bowsher’s 
keynote speech discussed the roles 
and relationships of the budgeting, 
accounting, program analysis, and 
auditing disciplines for the 1980’s 
and beyond. Mr. Bowsher noted that 
the Federal Government can no 
longer tolerate separate and uncoor- 
dinated planning, budgeting, pro- 
gram management, accounting, au- 
diting, and evaluation systems and 
stated that he would give high prior- 
ity to GAO work aimed at breaking 
down the excessive compartmen- 
talization of analysis and control 
functions in Federal agencies. He 
also called for establishing a com- 
mission or study group on budget 
concepts and procedures and sug- 
gested that the Congress consider 
shifting the Federal Government to 
a biennial budget cycle. 


Following the Comptroller Gener- 
al’s talk, a panel discussed the 
theme of Mr. Bowsher’s address: 
linkages among disciplines needed 
for effective Government manage- 
ment and policymaking. The panel 
was Chaired by Kenneth W. Hunter, 
senior associate director in the Pro- 
gram Analysis Division, and_in- 
cluded Raymond Schappach, Dep- 
uty Director of the Congressional 
Budget Office; John Lordan, Chief 
of the Financial Management 
Branch of the Office of Management 
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and Budget; Ray Long, Executive 
Director of the National Association 
of State Budget Officers; and Eileen 
Siedman, Assistant Inspector Gen- 
eral at the Department of Com- 
merce. 


Senator Roth, Chairman of the 
Senate Committee on Governmental 
Affairs, was scheduled to deliver 
the luncheon address, but due to the 
press of legislative business on 
the continuing resolution to fund 
the Federal Government, he was 
unable to attend. However, his 
speech was read by Tom Kramer, 
Director of Policy Planning for the 
committee. Roth’s speech focused 
on three areas of concern to his 
committee: (1) establishing a blue 
ribbon, Hoover-type commission on 
more effective Government, (2) refor- 
ming the processes by which regula- 
tions are developed and evaluated, 
and (3) reforming the congressional 
budget process. 


Mike Causey, who writes the 
“Federal Diary” column in The 
Washington Post, spoke on the 
latest developments and rumors of 
interest to Federal employees, in- 
cluding Federal health insurance, 
the pay cap on senior executives, 
and civil service reform. 


Five workshops addressed sev- 
eral Government reform measures 
in detail. GAO staff participated as 
panel members in three workshops: 
Harry Havens, in ‘“Micromanage- 
ment in the Federal Government,” 
James Kirkman, in “Further Budget 
Reforms,”’ and Robert Kershaw, in 
“A Commission for More Effective 
Government.” Workshops were also 
held on ‘Regulatory Reform and 
Analysis” and “Internal Review and 
Followup.” 


The AABPA, a professional soci- 
ety of about 900 members, including 
20 from GAO, is devoted to improv- 
ing the quality and usefulness of in- 
formation and analysis used in pub- 
lic management and policymaking. 
PAD’s senior associate director, 
Kenneth Hunter, is AABPA’s Vice 
President for Symposia. For more 
information on AABPA, contact 
Butch Black or Pat Mullen at 
275-3161. 
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Sing a Song of Audit Work? 


Appearing in the December 1981 
issue of The Internal Auditor, this 
verse seems appropriate to the 
audit scope of the GAO evaluator as 
well. Author Lawrence Sawyer com- 
posed this under the inspiration of 
Gilbert and Sullivan. 


We test without apology 

Both safety and ecology, 

And inventories, budgets, and 
production. 

Checking scrap and sanitation, 

Overtime and transportation, 

Not forgetting cost accounting and 
construction. 

We test sales and check insurance; 

EDP tries our endurance, 

As we audit payrolls, cash, and 
simulation. 

Study management by objective, 

Test controls that are defective, 

And evaluate employee 
compensation. 

We do sampling and regression, 


And there is a strong impression 

We’re responsible for catching all 
the crooks. 

We are really in our element 

With research and development, 

But, thankfully, we do not keep 
the books. 

We check aircraft, trucks, and motor 
cars, 

And rockets that fly to the stars, 

And leases, loans, and even 
personnel. 

We examine engineering, 

Even salvage is endearing, 

And we check on records 
management as well. 

There is nothing we can’t verify, 

There’s nothing that escapes our 
eye, 

Alert to all misconduct and to fraud. 

We will go where others fear to 
tread, 

And, as it has been often said, 

We’re the eyes and ears of 
management and the board. 





Trends in 


No evaluation is perfect. A certain 
and fully generalizable conclusion 
is a worthy goal, but it cannot be 
reached. The goal is impossible to 
achieve because of very practical 
limitations in our ability to design 
evaluations, to acquire information, 
and to analyze information. Al- 
though no empirical inquiry like an 
evaluation or audit is perfect, some 
are better than others. A concept 
used to express this gradation in 
quality is validity. 

Validity is important for two rea- 
sons. First, in planning an evalua- 
tion, we usually want the highest 
quality evaluation we can get sub- 
ject to cost, time, and administra- 
tive constraints. Second, in review- 
ing an evaluation (either the one we 
have responsibility for or that of 
another evaluator), we need a way to 
judge its quality. Validity provides a 
systematic frame of reference for 
planning or critiquing an evaluation. 
Planning an evaluation means mak- 
ing a number of decisions which 


Evaluation — 


Carl E. Wisler 


Mr. Wisler is an acting associate dir- 
ector in the Institute for Program 
Evaluation. 


either knowingly or unknowingly 
have implications for validity, but 
responsible planning or critiquing 
requires that these implications be 
known. 


Just as the task of planning or 
critiquing an evaluation is compli- 
cated, so is the concept of validity. 
Evaluators speak of four kinds of 
validity: construct validity, conclu- 
sion validity, internal validity, and 
external validity. An illustration of 
each is contained in an evaluation 
of the Follow Through Program, 
which was conducted several years 
ago. 


The Follow Through Program was 
intended to provide compensatory 
education and supplementary serv- 
ices to poor children in kinder- 
garten through third grade, and it 
used a variety of educational ap- 
proaches (called models) in dif- 
ferent schools. In the late 1960's, 
the Federal Government initiated a 
major evaluation to see which 
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models were more effective than 
others. 

Although it was a complex and 
expensive evaluation, the main 
ideas were fairly simple. A number 
of sample students from sample 
schools were tested to measure 
their verbal and math skills, self- 
esteem, abstract reasoning, and 
other skills. The scores were 
statistically analyzed to determine 
which educational models were 
benefiting the students. 


Construct Validity 


The evaluation was expected to 
test the theory that some new learn- 
ing models would raise the educa- 
tional attainment of poor children. 
The theory involved three con- 
structs: learning models, educa- 
tional attainment, and poor chil- 
dren. These constructs are broad 
and _ ill-defined. Measurement re- 
quires that the constructs be de- 
fined, that one or more measuring 
instruments be developed for each 
construct, and that the instruments 
be used to acquire data. Construct 
validity pertains to how well the in- 
formation produced by the measure- 
ment process corresponds to the 
constructs we want to know about. 

Consider, for example, the educa- 
tional attainment construct. In the 
Follow Through evaluation, educa- 
tional attainment was measured by 
the Metropolitan Achievement Test, 
so one aspect of construct validity 
was the extent to which the MAT 
represented the theoretical educa- 
tional attainment construct. From 
the time the Follow Through evalua- 
tion was planned to the time critics 
appraised the final results, con- 
struct validity was an issue. Some 
reviewers contended that the evalu- 
ation was not valid because the 
skills measured by the MAT were 
too narrow to embody the educa- 
tional attainment expected by some 
of the models. These reviewers held 
that failure to show gains on MAT 
scores should not be a basis for 
presuming ineffectiveness because 
the models may have positively af- 
fected some unmeasured indicator 
of educational attainment. Op- 
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ponents granted that the MAT did 
not encompass all possible interpre- 
tations of educational attainment, 
but they maintained that it did 
measure skills important to young 
children and that failure to show 
MAT gains should be regarded as a 
negative finding about a model. The 
debate continues on other educa- 
tional programs and evaluations. 


The concept of construct validity 
also applies to the other two con- 
structs: learning models and poor 
children. Learning models must be 
precisely defined so that the ap- 
proaches can be distinguished from 
one another and the extent of im- 
plementation can be measured. 
Likewise, the construct of poor 
children must be operationally 
defined so that natural variations in 
the characteristics of children par- 
ticipating in different learning 
models can be known. 


Conclusion Validity 


Conclusion validity most often 
applies to evaluations intended to 
estimate the effects of a program or 
activity. There are two possible er- 
rors in drawing conclusions about 
effects: concluding that effects ex- 
ist when they do not and concluding 
that effects do not exist when they 
really do. In the Follow Through 
evaluation, the MAT was used to 
compare the verbal and math 
achievement of children in new learn- 
ing approaches with children in 
traditional classrooms. Because of 
real-world, practical limitations, it 
cannot be stated with certainty that 
children in any of the Follow 
Through models learned more or 
less than children in_ traditional 
classrooms. The conclusions can 
be stated only in terms of probabil- 
ity. However, if an evaluation has 
been designed for high conclusion 
validity, one can be relatively certain 
whether effects exist. Many evalu- 
ators believe that evaluation 
designs often have insufficient con- 
clusion validity, especially in the 
designs’ ability to detect effects 
when they really exist. One way of 
trying to ensure sufficient conclu- 
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sion validity is to estimate in ad- 
vance the size of a sample that 
would be necessary to detect an ef- 
fect of a given size. 


Internal Validity 


Conclusion validity pertains to 
whether there really was an effect; 
internal validity is concerned with 
the cause of the effect. When look- 
ing for effects, evaluation is useful 
only if it can connect cause to ef- 
fect. In the case of Follow Through, 
if we conclude that children in one 
of the new learning models perform 
better in math than do children in 
traditional, comparison schools, the 
next logical question is: Can we at- 
tribute superior math scores to par- 
ticipation in the Follow Through 
model? Perhaps there was a ten- 
dency for the children in the Follow 
Through school to be superior even 
before enrollment in the special pro- 
gram. Or perhaps the air conditioner 
broke down the day of testing in the 
control school and students had to 
take the test under very uncomfort- 
able conditions. The possible alter- 
native explanations for the effects 
are often numerous, and the evalu- 
ator must devise ways to rule out 
competing causes. To the extent the 
evaluator is successful, the evalua- 
tion is said to have high internal 
validity. 


External Validity 


Policymakers frequently want to 
apply the results of an evaluation 
beyond the particular people, set- 
ting, and time which supplied the in- 
formation. If some of the Follow 
Through models are effective, the 
Congress might consider increasing 
the program's budget in future years 
and expanding the program to new 
schools and students. Should we 
expect the effects discovered in the 
evaluation to be repeated with other 
children in other places? This is the 
question with which external valid- 
ity (sometimes called generalizabil- 
ity) deals. The answer depends on 
how the children and schools in the 
evaluation were chosen and what 
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events occurred between the evalu- 
ation and the new application of the 
program. If the new children and 
schools are quite different and the 
school climate has changed, the 
program effects may also be quite 
different. Thus, external validity 
centers around the representative- 
ness of the evaluation situation. The 
conclusions can be extended legiti- 
mately to other situations which are 
similar in important respects. Exter- 
nal validity applies not just to pro- 
gram effects but to any information 
acquired in an evaluation. 


Summary 


The validity of an evaluation is a 
matter of degree. Depending on the 
type of evaluation, validity can have 
as many as four dimensions. In the 
planning stages, an evaluator must 
make many decisions, each of 
which will cause prospective valid- 
ity to increase or decrease along 
one or more of the dimensions. Typi- 
cally, these decisions involve trade- 
offs with other factors, such as 
cost, time, and administrative ease. 

Although validity is used to ex- 
press gradation in quality, it is not 
quantified. Achieving valid evalua- 
tions is somewhat of an art as well 
as a science. When a design deci- 
sion is made which affects conclu- 


sion validity and internal validity, 
most evaluators would probably 
agree on whether the decision will 
increase or decrease validity. With 
construct and external validity, a 
consensus may be less certain. The 
debate on the Follow Through Pro- 
gram illustrates differing opinions 
on how well an evaluation measure 
represents a construct. However, 
just exposing these differences can 
be an important aid to a policy- 
maker who wants to use the evalua- 
tion results. 

External validity can sometimes 
be disputed because it is based 
upon the notion of representative- 
ness—a concept that does not have 
a precise statistical definition. Also, 
a sample can be regarded as repre- 
sentative of one population but not 
of another. Again, however, being 
clear about the why and how of sam- 
ple selection helps determine the 
quality of the evaluation results for 
the particular generalization a poli- 
cymaker wants to make. A final 
point is that a design decision 
which increases validity along one 
dimension may decrease validity 
along another dimension. These and 
other considerations require careful 
deliberation when planning an eval- 
uation and a catholic viewpoint 
when critiquing one. 


For More Information 


The concept of evaluation validity 
grew out of similar but more limited 
ideas in psychometrics. Much more 
detailed discussions of the con- 
cepts, problems, and ways for evalu- 
ators to cope can be found in 


Cook, T. D., and Campbell, D. T. 
Quasi-Experimentation: Design 
and Analysis Issues for Field Set- 
tings. Chicago: Rand McNally, 
1979. 

Judd, C. M., and Kenny, D. A. Esti- 
mating the Effects of Social In- 
terventions. Cambridge, Mass.: 
Cambridge University Press, 
1981. 

Lindvall, C. M., and Nitko, A. J. 
“Basic Considerations in Assess- 
ing the Validity of Evaluation 
Designs.” Educational Evaluation 
and Policy Analysis, 3, No. 4 
(1981), pp. 49-60. 

Validity Issues in Evaluative Re- 
search. |. E. Bernstein, ed. Beverly 
Hills, Calif.: Sage Publications, 
1976. 
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Manager’s 
Corner 





As part of GAO’s Management 
Development Program, the “Manag- 
er’s Corner” feature provides a 
source of information on current 
management theory and practice. 
Its purpose is to expand the knowl- 
edge and skills of GAO managers by 
increasing their awareness of man- 
agement problems and achieve- 
ments. 

“Manager’s Corner’ presents a 
general bibliography as well as arti- 
cle abstracts on a particular topic 
chosen for each issue of the Review. 
The Office of Organization and 
Human Development provides 
copies of the articles to members of 
the Senior Executive Service and to 
SES candidates. You may request 
copies of articles from OOHD staff 
at 472-2315. Copies of articles are 
also available (for use in the library) 
at the front desk of the GAO Tech- 
nical Library, OISS. Your advice and 
comments are appreciated. 


General Bibliography 


Arnold, Mark R. “Unleashing Middle 
Managers.” Management Review, 
70, No. 5 (May 1981), 58-61. 


Calish, Irving G. ‘How to Overcome 
Organizational Resistance to 
Change.” Management Review, 
70, No. 10 (October 1981), 2-28, 50. 


Davidson, Jeff. ‘Don’t Manage Out- 
side the Office.” Supervisory 
Management, 26, No. 10 (October 
1981), 26-29. 


Davis, Tim R., and Fred Luthans. 
“Beyond Modeling: Managing So- 
cial Learning Processes in Hu- 
man Resource Training and De- 
velopment.’”’ Human Resource 
Management, 20, No. 2 (Summer 
1981), 19-27. 


Fox, J. Ronald. “Breaking the Regu- 
latory Deadlock.” Harvard Busi- 
ness Review, 59, No. 5 (September- 
October 1981), 97-105. 


Godet, Michel. “Creative Crisis: 
New Patterns of Growth and Em- 
ployment.” Long Range Planning, 
14, No. 5 (October 1981), 12-19. 
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Godwin, Phil, and John Needham. 
“Reforming Reform—Challeng- 
ing the Assumptions for Im- 
proving Public Employees’ 
Perfomance.” Public Personnel 
Management, 10, No. 2 (Summer 
1981), 233-243. 


Grimaldi, Joseph, and Bette P. 
Schnapper. ‘Managing Employee 
Stress: Reducing the Costs, In- 
creasing the Benefits.” Manage- 
ment Review, 70, No. 8 (August 
1981), 23-28, 37. 


Levinson, Priscilla L. “Face-Off or 
Face to Face? The Performance 
Appraisal Discussion.” Manage- 
ment, 2, No. 3 (Summer 1981), 
12-13. 


Klinger, Donald, and John Nalban- 
dian. ‘‘The Politics of Public Per- 
sonnel Administration: Towards 
Theoretical Understanding.” Pub- 
lic Administration Review, 41, No. 
5 (September/October 1981), 
541-549. 


Ouchi, William. ‘Going from A to Z: 
Thirteen Steps to a Z Theory Orga- 
nization.” Management Review, 
70, No. 6 (May 1981), 9-16. 


Pickhardt, Carl E. ‘‘Problem Posed 
by a Changing Organizational 
Membership.”’ Organizational 
Dynamics, 10, No. 1 (Summer 
1981), 69-80. 


Post, James E., and Lee E. Preston. 
“Private Management and Public 
Policy.” California Management 
Review, 23, No. 3 (Spring 1981), 
56-62. 


Schein, Edgar H. ‘SMR Forum: Im- 
proving Face-to-Face Relation- 
ships.’’ Sloan Management 
Review, 22, No. 2 (Winter 1981), 
43-52. 


Veiga, John F. “Plateaued Versus 
Non-Plateaued Managers: Career 
Patterns, Attitudes, and Path 
Potential.”” Academy of Manage- 
ment Journal, 24, No. 3 (Septem- 
ber 1981), 566-578. 


Organization and Planning 


Organization and planning are 


two of the basic functions of a man- 
ager; they demand that managers 
look to the future, are aware of re- 
sources and of organizational envi- 
ronment, and understand system- 
atic processes. In the following 
articles, organization and planning 
are discussed in terms of informa- 
tion systems, human resource man- 
agement, and finance. 

Members of the Senior Executive 
Service may receive copies of 
abstracted articles by contacting 
Kathy Karlson at the Management 
Development Center, 472-2315. 


Burack, Elmer H., and Edwin L. 
Miller. “A Model for Personnel 
Practices and People.” Personne! 
Administrator, 24, No. 1 (January 
1979), 50-56. 


Suggests that human resource 
management has a general manage- 
ment perspective, is connected to 
institutional planning, and supports 
personnel. Integrating comprehen- 
sive human resource planning with 
overall organization plans makes 
programs responsive to economic 
and policy needs of the agency. 


Garson, G. David. “The Institute 
Model for Public-Sector Manage- 
ment Development.” Public Per- 
sonnel Management, 8, No. 4 
(July/August 1979), 242-256. 


Describes North Carolina’s Gov- 
ernment Executives Institute (GEl) 
based on a _ productivity-oriented 
model. Guiding educational prin- 
ciples are based on 1) education 
rather than training, 2) mutual learn- 
ing, 3) generalistic content, and 4) 
applied organizational planning. 
Participants in the GEl indicated 
positive effects on confidence 
levels but did not increase dissatis- 
faction with superiors, unlike 
results of similar studies. Racial 
and sexual bias were absent in the 
GEI model, but lack of a stable 
reward system was found to be a 
major problem. 


Gilmour, Clark, and Gar Sheehan. 
“The Effect of Crisis on Organiza- 
tional Planning.” Journal of Gen- 
eral Management, 4, No. 2 (Winter 
1976/1977), 50-58. 





Manager’s Corner 


Presents a tentative model for the 
evolution of formal policy planning 
in the organization. Planning is 
dependent on changes in the firm 
and its environment, and major 
changes, especially adverse ones, 
cause quantum leaps in the devel- 
opment of the formal planning 
system. 


Gray, George R., and Eugene H. 
Hunt. “Human Resource Planning 
for Effective Management.” Man- 
agement World, 8, No. 11 
(November 1979), 25-26. 


Suggests that human resource 
planning has not always been well 
received because firms have used it 
for short-term replacement needs or 
used fragmented systems when 
planning. Suggests that human 
resources planning is a_ logical, 
systematic method of analyzing 
both organizational and job-unit 
needs. Furthermore, research sup- 
ports the notion that systematic 
planning saves time. 


Jain, S. L. G. “Organization Plan- 
ning—Concepts and Implica- 
tions.’’ AACE Transactions, 
F.1.1.—F.1.4. 1981. 


Organizational planning is the 
process of putting an organization 
into a systematic and coordinated 
way of working which has serious 
implications. Suggests that plan- 
ning requires considerable preplan- 


ning including identification of 
organizational strengths and weak- 
nesses, that planning depends on 
constant restructuring and check- 
ing, and that it must be supported 
by the organization’s personnel. 


Lindsay, William M., and Leslie W. 
Rue. “Impact of the Organization 
Environment on the Long-Range 
Planning Process; A Contingency 
View.” Academy of Management 
Journal, 23, No. 3 (September 
1980), 385-404. 


Study of the effect of organiza- 
tional environment on the long- 
range planning process. Found that 
firms tended to adopt more com- 
plete formal long-range planning 
processes as the complexity and in- 


stability of the business environ- 
ment increased. Findings were 
moderated by including the size of 
the company as an _ intervening 
variable. 


Neilson, Richard P. “Toward a 
Method for Building Consensus 
During Strategic Planning.” Sloan 
Management Review, 22, No. 4 
(Summer 1981), 29-40. 


Discusses consensus building as 
a way to reach balance between the 
goals of key groups of people in the 
organization and the organization 
itself. The process eases the fears 
of special interest groups, obtains 
support when power cannot be 
used, and makes for quick facilita- 
tion of plans. Shows how to use the 
process of consensus building 
through discussion groups, ad- 
visory boards, etc. 


Reid, Thomas J. “The Content of 
Management Development.” Per- 
sonnel Journal, 53, No. 4 (April 
1974), 280-287. 


Describes the kinds of manage- 
ment development strategy needed 
depending on the circumstances of 
the cooperative system or organiza- 
tion. As an organization evolves, the 
role of management development 
will change, and its role can be iden- 
tified if its functions are part of 
organizational planning. 


Wu, Frederick H. “‘Incrementalism in 
Financial Strategic Planning.” 
Academy of Management Review, 
6, No. 1 (January 1981), 133-143. 


Suggests that theories in strate- 
gic planning can be classified as 1) 
entrepreneurial, 2) adaptive, and 3) 
planning. Suggests that incremen- 
tal analysis can overcome the in- 
herent weaknesses of comprehen- 
sive planning since people are 
restricted in their abilities to assess 
problems and offer optimum solu- 
tions. 


Ziehe, Theodore W. “What Manage- 
ment Should Know about IRM.” 
Computerworld, 14, No. 42 (Oc- 
tober 13, 1980), 9-14. 


Defines IRM (information re- 


source management) as part of the 
planning process and as an impor- 
tant support to data management. 
Suggests that top management 
must recognize information as a re- 
source, that managers must be 
asked what information they need, 
and that managers need to learn 
what information is appropriate to 
specific tasks. Shows process for 
drawing up an IRM pian. 

Zemke, Ron. “Integrating Strategic 
Planning and Manpower Plan- 
ning.” Training, 17, No. 10 (Oc- 
tober 1980), 31-35. 


Suggests that the human re- 
source manager must learn to think 
in the same future-oriented way as 
top managers and that human re- 
source development must become 
part of an agency’s strategic plan- 
ning. 


GAO Review/Spring 1982 





A Different Perspective: 
Intergovernmental 


Auditing and Evaluation 


In promoting GAO’s efforts to seek cooperation among Federal, State, 
and local auditors and evaluators, the Review presents this intergovernmen- 
tal series. We encourage our State and local colleagues to contribute ar- 
ticles relevant to the intergovernmental audit and evaluation community. 


Program Evaluation by 
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States and Loealities: 
Overview and Outlook 


Much attention has been focused 
on program evaluation at the 
Federal level, perhaps because 
evaluation studies at that level are a 
common and frequent occurrence. A 
recent GAO survey showed, for ex- 
ample, that 164 evaluation units 
conducted a total of 2,362 evalua- 
tions during fiscal year 1980. Far 
less attention has been given to 
evaluations at State and local 
levels. 

This article will discuss program 
evaluation conducted by the State 
and local governments and _ high- 
light some of the problems and the 
potential benefits of evaluation 
groups at these levels. 


State/Local 
Evaluations Vary in 
Size and Organization 


Although the exact number of 
evaluation units at State and local 
levels and the precise nature of their 
work are unknown, some enlighten- 
ing data is available. As part of an 
effort to test certain communication 
techniques (see GAO Review, Fall 
1981, p. 1), GAO’s Atlanta staff 
developed an inventory of evalua- 
tion units in the Southeast (Federal 
Region IV).! Through a 50-State 
survey, units in the Southeast were 
determined to be representative of 
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auditor in the Atlanta regional office and 
has served in the GAO headquarters and 
European Branch offices. He has a B.S. 
degree in accounting, an M.S. degree in 
public administration, and is a CPA 
(Tennessee). 
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Mr. Gibson is professor emeritus of political 
science at the University of Georgia and 
currently is associate professor of public 
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Central Florida. He has also taught at the 
University of Virginia and at West Virginia 
University. He has written extensively in the 
fields of policy analysis and program evalu- 
ation, and he currently serves as one of 
GAO's consultants. 


those in the other States. 

The State and local governments 
vary widely in their evaluation ac- 
tivities. At least 19 units in the 
8-State Southeast area conduct 
some form of program evaluation 
work. However, there appears to be 
no common organizational setting 
for the units. Rather, evaluation 
units can be found in both legisla- 
tive and executive branches and, 
within those branches, at various 
locations. The number of units in 
each State varies greatly—from 1 to 
5 according to GAO’s survey—as do 
the number of employees assigned 
(from as few as 11 up to 120). 

The number of reports issued by 
the units during the 18 months 
ended July 1981 ranged from 8 to 
166. Atlanta’s survey indicated, too, 
that the units differ markedly in the 
nature or sophistication of the eval- 
uations performed. 


A Growing Enterprise 


Evaluation activities may differ in 
many ways among States and local- 
ities, but they all seem to have at 
least one thing in common: the num- 
ber of evaluation studies is increas- 
ing. An indication of this growth is 
provided by the Eagleton Institute at 
Rutgers University, which accumu- 
lated abstracts of evaluation 
reports prepared by State legislative 
units for more than 10 years. A com- 
parison of data on such abstracts 
can be seen in figure 1.2 


Thrust of State /Local 
Program Evaluation 


Like their size and organizational 
setting, evaluation units at State 
and local levels vary also in the 
nature or thrust of work they per- 
form. Program evaluation by the 
States is often conducted pursuant 
to Federal grant provisions, which, 
in earlier years, were no doubt a driv- 
ing force behind the advent of State 
evaluation activities. More recently, 
State “sunset” laws have often pro- 
vided the stimulus for program 
evaluation. 

About 35 States now have sunset 
laws that range from very compre- 
hensive acts, covering all executive 
departments, to more restricted— 
and more common—statutes that 
encompass only regulatory or li- 
censing agencies. Florida’s sunset 
laws, for example, cover regulatory 
agencies, with most subject to 
5-year review cycles, and the Gov- 
ernmental Operations Committee of 
the State legislature is designated 
to conduct sunset evaluations in 
that State. Program evaluation in 
Florida is also conducted by a 
recently created Office of Program 
Evaluation in the executive branch 
and the State Auditor General’s Of- 
fice. 

Other States have established 
strong evaluation units without the 
impetus of sunset laws. For exam- 
ple, while Mississippi does not con- 





Figure 1 
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1970-74 


1975-79 increase 





Reports received 





130 
Units reporting 21 
States represented 16 


805 520 
63 200 
39 146 
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duct sunset reviews, it has a fully 
staffed unit called the Joint Legisla- 
tive Committee on Performance 
Evaluation and Expenditure Review 
(PEER). This body, modeled 
somewhat from GAO, has been in 
existence since 1973 and has issued 
over 100 reports in addition to 300 
technical letters. 

At the local level, the thrust of 
evaluation is aimed at management 
improvements, with emphasis on 
identifying more efficient methods 
of delivering municipal or county 
services. Thus, local units carry on 
experiments with one- versus two- 
officer patrol cars; with various 
methods of collecting and dispos- 
ing of garbage; with varying tech- 
niques of handling administrative 
tasks, such as tax collection and 
auto tag applications; with different 
ways of providing physical and men- 
tal services—and the like. 

To illustrate this emphasis on ef- 
ficient services, one city uses 
before-and-after camera shots, com- 
bined with a record of citizen com- 
plaints, to test the efficiency/ 
effectiveness of new methods: of 
collecting garbage. Another city 
uses a machine that measures the 
smoothness of streets in determin- 
ing which method of street resurfac- 
ing is superior. Evaluation studies 
of this nature are typically carriéd 
out by units attached to the city/ 
county manager’s office or as part 
of a budget unit similarly located. 


Some State /Local 
Evaluation Problems 


Because of the vast differences 
among State and local evaluation 
groups, a succinct and represen- 
tative statement of the problems 
those groups face is hardly possi- 
ble. However, while evaluation 
groups at those levels generally 
contend with the same problems 
confronting their Federal counter- 
parts, their problems are greater in 
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degree. A few of the more important 
problems are highlighted here. 


Unclear Program Goals* 


The results of program evalua- 
tions are more likely to be used 
when at least some program goals 
are stated to permit some degree of 
measurement of how well the goals 
were achieved. Federal laws creat- 
ing public programs usually specify 
the goals to be achieved, but the 
same cannot always be said for 
State statutes and local ordinances. 

Large executive departments in 
State governments, such as human 
services, offender rehabilitation, 
and transportation departments, 
often prepare bills for legislative 
consideration that include goal 
statements. However, most State 
statutes are either silent on goais or 
define the goals so broadly as to 
preclude measurement. 

Moreover, the paper trail that per- 
mits evaluators to ascertain legisla- 
tive intent at the Federal level sim- 
ply does not exist at State/local 
levels. Unlike the Congressional 
Record, which contains a detailed 
account of all congressional de- 


bates and testimony, proceedings 
of State legislative bodies are usu- 
ally limited to digests of speeches 
and printed roll call votes. At the 
Federal level, congressional com- 
mittee proceedings are accurately 
and completely detailed as to testi- 
mony given, questions propounded 
by legislators, and any evidence or 
exhibits entered into the record. 
Committee activities at State and 
local levels, if recorded at all, are 
simply digests of proceedings. 

At the local level, program goals 
often can be stated with great preci- 
sion, but they seldom are. Figure 2, 
taken from the records of the City of 
Riverside, California, is unusual in 
its completeness and _ illustrates 
how specific, measurable program 
goals can be established. 

Most local ordinances and pro- 
gram goals are not stated precisely 
enough to permit measurement. For 
example, a local law enforcement 
ordinance might call for making the 
city’s “streets safe for pedestrians” 
or for simply “reducing crime.” The 
ordinance could, on the other hand, 
provide for a 10-percent reduction in 
stranger-to-stranger street crime 
over a 2-year period. If base figures 





Program goal: 


way. 


Subprogram 
goal: 


Subprogram 
objectives: 


Operational 
objectives: 





Figure 2 


GOALS AND OBJECTIVES OF THE STREET SERVICES PROGRAM 
City of Riverside, CA (1976) 


To provide for the safe and efficient movement of 
vehicles and pedestrians through maintenance and 
repair of all facilities located within street right-of- 


To conserve the value of city streets, alleys and side- 
walks through an effective maintenance program. 


Maximize the life of streets and alleys through an ef- 
fective preventive maintenance program. 


Resurface a total of 620 miles of streets on an 
average of once every 6 years or 103 miles annually. 
Refurbish all street painting annually. 











Program Evaluation by States and Localities: Overview and Outlook 


on stranger-to-stranger street 
crimes are available, if all new 
crimes are reported, and if the rec- 
ordkeeping system remains un- 
changed over the program’s 2-year 
life, one could certainly arrive at 
some tentative conclusions regard- 
ing the program’s success. 


Too Few Evaluation 
Personnel 


In the Atlanta survey mentioned 
earlier, a rather consistent refrain 
running through the responses was 
that of inadequate resources, pri- 
marily a lack of trained personnel. 
Many respondents suggested that 
the Federal Government could aid 
immeasurably in training State and 
local personnel in evaluation tech- 
niques. 

This response was not unex- 
pected since relatively few schools 
offer substantial programs in pro- 
gram evaluation. And, as always, a 
shortage of funds hinders recruiting 
and hiring evaluators. In some 
cases, the evaluation function is 
simply added to an existing func- 
tion. This practice is almost certain 
to create a climate for frustration 
and a dislike of evaluation among 
the recipients.5 


Lack of Methodological 
Know-how 


Even when adequate personnel 
are available, State and local evalu- 
ation units face “state-of-the-art” 
problems in methodology. Respon- 
dents to the Atlanta survey wanted 
coordination among all levels of 
government. This coordination 
would help make Federal experi- 
ence and expertise available to 
State and local governments and 
would permit exchanges of informa- 
tion and data. 

It seems fair to say that, in many 
State and local governments, pro- 
gram evaluation is still in its in- 
fancy. And among even more ad- 
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vanced evaluation groups, difficult 
problems exist in selecting and ap- 
plying appropriate methodologies. 
Techniques and methods developed 
in universities or in staff units may 
work well in theory, but they fall far 
short of the mark when tried in the 
real world. Also, experience has 
shown that exquisite mathematical 
models, which make use of great 
quantities of data and highly 
sophisticated statistical manipula- 
tion, may fail badly in the turmoil of 
interest group politics. 


Political Pressures 


Another problem is the ever- 
present threat of political inter- 
ference in the State and local evalu- 
ation process. Although those at the 
Federal level often feel, indirectly, 
the political pressures of evalua- 
tions, the pressure is usually strong- 
est and felt most directly by legisla- 
tors and administrators at the State 
and local levels. Mention is often 
made of ‘‘sacred cows” and the in- 
cipient danger of examining them 
without prior legislative support. 
There are many sacred cows at the 
State and local levels. 

Political pressures can also in- 
hibit the use of desirable or even 
necessary evaluation methodology. 
This problem is often manifested 
when attempting to evaluate new 
programs or treatments in educa- 
tion, public health, or welfare ser- 
vices. Methodological requirements 
may clearly dictate the random 
assignment of subjects for treat- 
ment and control groups. However, 
such assignments are almost 
always politically prohibited. 


Data Difficulties 


Program evaluation in a Federal 
agency can be immeasurably easier 
than at State and local levels be- 
cause a body of coherent data and 
information is available to Federal 
evaluators. State and local evalu- 


ators face the problems of in- 
complete and often inaccurate data, 
gaps in information because of 
records gone astray, estimated 
rather than exact figures, and a lack 
of baseline statistics. Because of 
Federal grant provisions, this weak- 
ness is being corrected to a degree. 
However, evaluators often still find 
it impossible to use a technique, 
such as time-series analysis, be- 
cause of inadequate data. 


Some Criteria for 
Success 


Despite these seemingly insur- 
mountable problems, program eval- 
uation is considered a success in at 
least some States. What factors ac- 
count for the success are not al- 
ways clear, and surely the factors 
will vary depending on the particular 
State or locality. For example, John 
Turcotte, director of the Mississippi 
PEER Committee, suggests that, 
when program evaluation had been 
most successful in that State, one 
or more of the following factors 
were present: 

1. The program selected for review 
had previously generated intense 
legislative interest, in contrast to 
isolated or academic interest. 

. The project focused on issues 
which had been repeatedly ad- 
dressed informally by the legisla- 
ture without benefit of sound 
technical data. 

. If a sacred cow was challenged, 
legislative support for the chal- 
lenge was determined in ad- 
vance. 

. If recommendations were offered 
for administrative consideration, 
the program managers and 
agency heads were management- 
conscious, creative, and in- 
novative as well as generally 
receptive to outside recommen- 
dations. 

. The project contained recom- 
mendations which were useful to 
appropriations committees in 
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reallocating resources for great- 

er efficiency, economy, or effec- 

tiveness. 

6. Oversight staff were directly in- 
volved in the implementation 
process. 

Similarly, Dr. Ralph Craft (see 
footnote 2) has listed factors 
leading to the success or failure of 
program evaluation as a tool for leg- 
islative oversight.’ 

1. Attitudes of evaluators and eval- 
uatees—Oversight frequently 
falls behind the other activities of 
the legislators because it can be 
politically dangerous and pro- 
duces few political rewards. 
Thus, topics must be chosen that 
will get and keep the attention of 
legislators. Likewise, administra- 
tors typically view evaluation 
with suspicion; they must be 
made to see that evaluation will 
offer results in improving their 
departments’ performance. Ad- 
ministrators must also be con- 
vinced that the legislature will 
give serious attention to evalua- 
tors’ recommendations. 


Expectations—Legislative over- 
sight should start slowly with 
only very modest expectations. 
Linkage—To have effect, over- 
sight activities must fall in with 
the way the legislature conducts 
its business. For example, legis- 
lators prefer to work through 
committees, so the ideal over- 
sight structure would probably 
be a joint appropriations commit- 
tee staffed with a group of pro- 
fessionals whose only respon- 
sibility is oversight. 

4. Process—Legislators must be in- 
volved in the evaluation process 
from initiation through the final 
report stage. 

5. Continuity—This simply means 
being there year after year to ask 
the same types of questions and 
to demonstrate the commitment 
of the legislature to oversight. 
And, finally, Dr. Craft makes this 

important point: “Oversight should 
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not be totally divorced from 
politics.”” Oversight often takes 
place in a politically charged envi- 
ronment, and while evaluators 
should not be politicized, those who 
manage evaluation units cannot af- 
ford to ignore political realities. 

In summary, evaluators seem to 
agree on certain essential condi- 
tions for making program evaluation 
work—at ail levels of government. 
We would emphasize, too, the need 
for the evaluator to take a longer 
view. Good evaluation results come 
slowly. Certainly, administrators 
and legislators will not always greet 
the evaluator’s recommendations 
without reservations. 


Conclusions 


Quite clearly, State and local gov- 
ernments are demonstrating in- 
creasing interest in and a stronger 
commitment to program evaluation. 
As the public becomes more sen- 
sitive to program evaluation and to 
the concomitant concept of ac- 
countability, there likely will be con- 
tinuing pressure at all levels of 
government to produce and use 
evaluation reports. 

What’s more, the emerging em- 
phasis on block as opposed to cate- 
gorical grants is bound to focus at- 
tention on the evaluation process at 
State and local levels. While State 
and local governments may be given 
wider latitude in the expenditure of 
Federal grant funds, chances are 
that managers at those levels will 
also be held accountable—in a pro- 
grammatic as well as a fiscal 
sense—for how they use those 
funds. Indeed, the indications are 
that the challenges for both State 
and local evaluators are just begin- 
ning. 





‘Another part of that effort is a series of 
monographs on program evaluation to be 
published jointly by GAO and the University 
of Georgia. Throughout this article, 
reference is made to such monographs 
which are currently in process. 

2Information provided by Dr. Ralph Craft, 
formerly with the Eagleton Institute, now 
with the National Conference of State Leg- 
islatures, Washington, D.C. 

3For further details, see Litz, Ernie, 
Legislative Oversight: A Review of Sunset 
Laws. This document is included in the 
publication mentioned in footnote 1. 

4For an extended discussion of the place 
and importance of goals, see Rahimi, 
Maurice and Linda Rahimi, Guidelines for 
State and Local Officials on Objective Set- 
ting and Data Gathering Techniques for 
Program Evaluation. This document is in- 
cluded in the publication mentioned in foot- 
note 1. 

5For a review of the problems of recruit- 
ing and retaining evaluation personnel, see 
Ronald Hy, Personnel for Evaluation, GAO, 
forthcoming. Refer to the monographs men- 
tioned in footnote 1. 

6See his paper ‘Legislative Oversight” 
presented at the 1981 Annual Meeting of 
the Southern Public Administration Society, 
Jackson, Mississippi, October 1981. 

"Ibid. 
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Program Evaluation 
and the Reagan 


Administration: 
The California Years 


This article was adapted from a speech 
prepared for the Annual Meeting of the 
Evaluation Research Society in Austin, 
Texas, on October 1, 1981. 


It is entirely appropriate to ques- 
tion whether program evaluation 
will be an important tool for 
policymaking and management in 
the Reagan Administration. But 
before we can resolve this question 
and any others, we might consider 
what the Reagan gubernatorial ad- 
ministration expected and received 
from the evaluative efforts it sup- 
ported or experienced in California 
during 1971-1974. 

By reviewing my own program 
evaluation experience in California 
during this time, we may discover 
clues to what is in store for program 
evaluation in this Administration. 
As my evaluations in California 
dealt mostly with crime and delin- 
quency prevention and criminal 
justice programs, the examples in 
this article will be taken from those 
areas. 

Program evaluation is too broad a 
concept to discuss in generalities, 
so let us discuss issues and prac- 
tices in three basic categories: 
evaluation policy, management of 
evaluation functions, and capacity- 
building for doing and using evalua- 
tion. 

Although no formal declaration of 
State governmentwide policy for 
program evaluation efforts ema- 
nated from the Governor’s Office, 
each executive agency was ex- 
pected to employ appropriate and 
effective management practices to 
assure that administration policies 
were implemented. It is probable 
that an arrangement similar to the 
State policy on evaluation will exist 
between the Reagan presidency and 
the Cabinet departments. 

The last 2 years of the gubernato- 
rial administration saw an effort to 
expand the scope of program evalu- 
ations horizontally across State 
departments and agencies to ex- 


amine the cross-program effects 
and side effects in different policy 
and program areas. The Presidential 
Administration might need evalua- 
tion activities of a similar horizontal 
scope to assist the ‘Cabinet coun- 
cils” in formulating Administration 
policy, since each Cabinet council 
deals with different policy clusters 
and many related programs simulta- 
neously. 

In California during the early 
1970’s, program evaluation ac- 
tivities were frequently imple- 
mented on a decentralized, intergov- 
ernmental basis. State agencies 


typically were involved in outcome 
evaluation studies, impact assess- 
ment, and data base development 
activities, while counties, cities, and 
multiple governmental planning en- 


tities focused on process evalua- 
tions, Management analysis, and 
various monitoring efforts. In some 
instances, full-blown formative 
evaluation studies were also under- 
taken at both State and local levels 
of government, but these tended to 
be fewer in number and were tied 
to specific research/action-demon- 
stration efforts involving Federal 
grants. So here we may perceive a 
parallel to the President’s policy on 
federalism: decentralization or 
“devolution” of social program deci- 
sionmaking responsibilities to State 
and local governments through con- 
solidated block grants. In fact, 
future program evaluation responsi- 
bilities and policy expectations may 
tend to reflect a similar depth, or 
vertical movement, of program eval- 
uation down to State and local 
policymakers and decisionmakers 
to accompany the shift in program 
direction and responsibility. Conse- 
quently, there might be less struc- 
ture and a reduced volume of evalu- 
ative activities occurring at the 
Federal level. 

Another indicator of the potential 
direction of Federal program evalua- 
tion policy may be reflected in the 
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division of labor in California’s early 
efforts to evaluate clusters of like 
projects (10 to 15 projects per 
cluster) in criminal justice and more 
sophisticated program level evalua- 
tions. The cluster evaluations were 
of two types. The first involved 
groups of counties that pooled their 
resources to evaluate those proj- 
ects being implemented in their 
jurisdictions. The second type in- 
volved the State Planning Agency, 
contract evaluators, and selected 
counties and cities involved in the 
projects under evaluation. Although 
these early cluster evaluations had 
many problems and mixed benefits, 
the die was cast for program evalua- 
tions that were purposely planned, 
designed, and implemented as in- 
tergovernmental efforts. In program 
level evaluations of ‘‘diversion” and 
‘‘Scommunity-based corrections,” 
the division of labor between State 
and local governments became even 
more evident. The State agencies 
provided a design framework, of- 
fered technical assistance, and 
helped establish common defini- 
tions for data comparability to 
assess effectiveness among and be- 
tween similar programs. 

To the degree that program evalu- 
ations are still considered important 
tools for policy formulation and 
decisionmaking, such efforts prob- 
ably will be encouraged by this Ad- 
ministration, but with fewer man- 
dates on State and local govern- 
ments regarding methods or arbi- 
trary reporting requirements. Where 
it would make sense for a combined 
Federal, State, and local evaluation 
effort, such arrangements would 
probably be made at the departmen- 
tal level rather than in OMB or the 
White House. 

In the California period, there 
were some efforts to tie cost or 
budgetary data to evaluation find- 
ings to determine cost effec- 
tiveness, conduct cost-benefit 
studies, or merely make cost com- 
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parisons between different public 
policies and programs. Given the 
cost-conscious nature of this Ad- 
ministration and the reduction of 
support for public programs at the 
State and local levels, cost effec- 
tiveness and cost-benefit evalua- 
tions will probably be stressed and 
encouraged. 


Meeting Users’ Needs 


In California in 1972-1973, disen- 
chantment with untimely, irrelevant 
evaluations motivated a study of 
evaluation information use. Subse- 
quent changes in State evaluation 
policies and evaluation planning 
emphasized both decision-based 
evaluations and greater attention to 
identifying the evaluation needs of 
different user groups. In 1974, 
evaluation planning activities in the 
criminal justice policy area adopted 
a_ utilization-focused paradigm: 


USERS-NEEDS-OBJECTIVES- 
DESIGN. This approach was devel- 


oped to plan and design evaluation 
studies to meet the information 
needs of criminal justice policy- 
makers and decisionmakers. 
Federal evaluation policy during 
Reagan’s presidency will probably 
call for evaluations which are 
decision-based. Cabinet heads 
responsible for policy implementa- 
tion will have wide latitude in 
deciding what to evaluate and how, 
but ultimately, they are accountable 
to the President and the Congress in 
achieving the stated policy objec- 
tives. Evaluation planning probably 
will be agency-based and specific 
to those programs for which each 
agency is administratively responsi- 
ble. Consequently, management 
decisionmaking at the Federal level 
may tend to use evaluation findings 
that bear on those critical policy 
questions confronting the agency. 


Synthesis 


Just before California’s guberna- 


torial administration change in 
1975, several efforts were made to 
achieve a rational synthesis of eval- 
uation research findings and con- 
struct a reference service not unlike 
UCLA’s “Data Bank on Program 
Evaluation.” 

In this particular area, it is too 
early to tell whether Federal evalua- 
tion policy will address problems of 
synthesis and meta-analysis. Clearly, 
the “Cabinet council” framework 
and decentralizing much govern- 
mental decisionmaking to State and 
local officials could warrant arguing 
for Federal action in synthesizing 
and extending information from 
past evaluations to aid policymak- 
ers at all government levels. 


Management 


Evaluation functions during the 
Reagan era in California were highly 
decentralized. This reflected the 
basic philosophy that the executive 
department heads accountable for 
success in policy implementation 
should decide how best to organize 
their respective evaluation func- 
tions to meet management deci- 
sionmaking needs. 

You may recall that many activi- 
ties in California were carried out in- 
tergovernmentally and with a divi- 
sion of labor, which purposely kept 
the State evaluation bureaucracy 
rather small compared with those in 
other States during the same time. 
In the area of criminal justice, it was 
a basic premise that local govern- 
ment officials should decide which 
programs and projects they would 
adopt and support locally. Conse- 
quently, since these officials had a 
greater need for evaluation informa- 
tion which would aid such deci- 
sions, evaluation activities tended 
to be more numerous and more in- 
tensive at the local level than at the 
State level. However, where the 
State department head believed 
there was a legitimate need to pro- 
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vide an independent evaluation, 
contractors performed evaluation 
work under State auspices on spe- 
cific priority programs, or they ad- 
dressed policy questions on a very 
selective basis. As one illustration, 
the California Specialized Training 
Institute at San Luis Obispo, Califor- 
nia, provided officer survival train- 
ing to local police agencies across 
the State, from other States, and 
even from foreign countries. Since 
this program had a statewide scope, 
the State Planning Agency planned 
the evaluation and supervised its 
implementation, which was _ per- 
formed by a third party. Evaluation 
directors, for the most part, were 
given considerable latitude and suf- 
ficient resources to carry out those 
evaluation responsibilities dele- 
gated by the department heads. The 
same principles of delegated and 
decentralized management philos- 
ophy were evident in many of the 
evaluation units. If we accept the 
premise that a decentralized man- 
agement structure can still be a 
viable system for organizing evalua- 
tion tasks, then the California evalu- 
ation scene was in fact a system. 
Also, it should be noted that the 
California State legislature had, for 
its day, a rather sophisticated audit 
and program review capability in the 
Office of the Legislative Analyst. As 
the legislative branch increased its 
oversight responsibilities, the State 
cabinet departments beefed up their 
own evaluation staffs to conduct 
management studies and program 
evaluations to improve manage- 
ment in their respective depart- 
ments. 

| would anticipate a similar paral- 
lel during the Reagan presidency. 
OMB will probably continue its role 
of admonishing the heads of ex- 
ecutive departments to improve 
their management activities through 
appropriate use of evaluation ac- 
tivities and information, as stated in 
OMB Circular A-117. Agency heads 
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will have significant discretion in 
deciding what evaluation functions 
they believe are most appropriate 
and conducive to achieving effec- 
tive policy implementation. They 
will then decide how best to orga- 
nize their program evaluation ef- 
forts. There is probably minimal or 
no chance that an “evaluation czar” 
will direct Federal evaluation efforts 
in the Executive Office of the Presi- 
dent. 

Some oversight of Federal pro- 
gram evaluation activity by OMB 
and the Congress is very likely, but 
such oversight will probably test 
evaluations for legislative com- 
pliance and use in management 
decisionmaking rather than specifi- 
cally directing how the executive 
departments should organize and 
carry out their respective evaluation 
responsibilities. 

What remains to be seen is how 
the consolidated block grants will 
influence the types and amounts of 
program evaluation performed 
under Federal auspices and what 
evaluation functions will be dele- 
gated to State and local government 
Officials. Obviously, there will be 
fewer requirements for evaluation in 
“blocked” programs placed on 
States and localities. However, 
“nonblocked” programs may retain a 
Federal character and warrant differ- 
ent levels of evaluation effort to sup- 
port management decisionmaking. 

On the whole, program evaluation 
processes and results may become 
more important to State and local 
government officials for those pro- 
grams now consolidated within 
block grants. Hence, under the 
decentralization theme of the Presi- 
dent’s policy on federalism, each 
State and cognizant local govern- 
ment will decide how best to 
organize and manage those evalua- 
tion activities that will help them 
make difficult program and re- 
source allocation decisions. Those 
evaluation efforts and results which 


prove to be useful in State and local 
policy and decisionmaking will have 
the best chance of continuing. 

One significant concern is 
whether States and localities have 
the management “muscle” and 
evaluative capability to do and use 
program evaluation in ways that will 
help them distinguish between vari- 
ous policy and program alter- 
natives. The loss of direct Federal 
presence in program evaluations 
could result in the same “with- 
drawal pangs” being felt from 
Federal budget cuts in domestic 
programs. Professional evaluators 
will find they have to convince State 
and local officials that their evalua- 
tion work can and does meet official 
policymaking and decisionmaking 
needs. Evaluation will have to com- 
pete with other management de- 
mands to obtain necessary re- 
sources. This requires redefining 
the evaluation consumers and 
devoting even more attention to 
their information needs. 

If State and local governments 
are now expected to decide which 
programs in a block grant stay and 
which ones expire, but the govern- 
ments are not suitably prepared to 
plan, design, implement, and use 
evaluation processes and informa- 
tion, shouldn’t the Federal Govern- 
ment help them develop the neces- 
sary evaluation capability? | believe 
the answer should be yes. But then 
we must question what kinds of 
assistance are needed, what can 
the Federal Government provide, 
and who should pay for it. 

There is a wealth of experience 
available among Federal managers. 
It could be shared with State and 
local people through technical and 
management assistance, training 
seminars and workshops, and fed- 
erally assisted evaluation capacity- 
building demonstrations or models. 
These could be carried out in dif- 
ferent State and local jurisdictions 
on some competitive basis. Suc- 
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cessful experiences and practices 
for organizing evaluation perfor- 
mance and using evaluation infor- 
mation could then be shared with 
others as part of further technical 
assistance and training service sup- 
ported by the Federal Government. 

During the Reagan years in Cali- 
fornia, shared responsibility and 
capacity-building were considered 
appropriate roles for the State, 


especially in light of the decentral- 
ized policy and decisionmaking 
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structure characteristic of that 
period. With the transfer of program 
responsibilities from Federal to 
State and local governments, the 
need for evaluation technical assis- 
tance and training is recognized. Ex- 
actly how it will be provided, and 
who will do it, remains to be deter- 
mined. 

Clearly, the Federal Government— 
whether it be through OMB, Cabinet 
agencies, or GAO—will share suc- 
cessful evaluation practices and in- 


formation with State and local gov- 
ernments. But it will be up to the 
evaluation community to convince 
these State and local policymakers 
that evaluation is needed, useful, 
and can be supported out of the 
savings realized through improved 
effectiveness and elimination of in- 
effective publicly supported pro- 
grams. Program evaluation will have 
to be able to pay its own way. 
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Can Our Food Supply 
Ever Be Completely 
Risk-Free?’ 


Scientists and policymakers to- 
day are faced with difficult issues 
regarding the safety of our food sup- 
ply. It is generally recognized that 
we in the United States have per- 
haps one of the safest food supplies 
in the world. But is it safe enough? 
The development of new techniques 
has enabled scientists to detect 
potentially harmful substances in 
the food supply, even when they oc- 
cur in extremely small amounts. 
However, techniques to determine 
the long-term risks from these 
substances have not kept pace. 
Federal law prohibits adding to the 
food supply any substance which 
causes cancer in man or animals, 
regardless of the benefits. Since in- 
creasing numbers of carcinogens 
are being found in food in extremely 
smali quantities, policymakers must 
decide whether they can be effec- 
tively eliminated or whether the law 
should be changed. 

In 1906, there were wide abuses in 


the U.S. food supply. Meats con- 
tained boric acid, sulphurous acid, 
and saltpeter. Ground coffee was 
laced with charcoal, bark, and date 
stones. Cocoa was adulterated with 
starch, nutshells, sawdust, and 
ground olive stones.” In response to 
these problems, the Congress en- 
acted the first food and drug law on 
February 21, 1906, to regulate in- 
terstate commerce in misbranded 
and adulterated foods, drinks, and 
drugs. 

Since the early 1900’s, innova- 
tions in the food processing in- 
dustry have caused significant 
changes in the concerns about the 
safety of the food we eat. Technol- 
ogy has transformed the food sup- 
ply from the relatively simple prod- 
uct of local farming into the output 
of a multibillion-dollar industry. 
Modern-day processing has helped 
to make foods cheaper, more readily 
available, convenient, and generally 
free from contamination. 
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With these innovations, however, 
has come a whole new series of 
problems. Increasingly, the public 
and the Congress are concerned 
about the presence and potentially 
harmful effect of some substances 
which are added to foods for a vari- 
ety of purposes. At the present time, 
there are more than 2,700 known 
food additives, of which FDA regu- 
lates more than 1,100. These are 
used for such diverse purposes as 
coloring, drying, and flavoring 
agents; nutrient supplements; pre- 
servatives; solvents; stabilizers; 
thickeners; sweeteners; and textur- 
izers. These substances typically 
appear in foods in extremely small 
quantities and may be biologically 
inert, possess desirable pharmaco- 
logic properties, or be toxic either 
for sensitive individuals or when 
consumed in sufficient quantity.* 

It has been estimated that the 
average American consumes yearly 
about 139 pounds of these food ad- 
ditives—including about 109 pounds 
of sugar and 14 pounds of salt.‘ 


Federal Regulation of 
Food Additives 


In June 1952, a congressional 
committee chaired by Congressman 
James J. Delaney issued a report 
which surveyed the use of chemi- 
cals in food and cited several exam- 
ples of harmful chemicals that had 
been used. The report concluded 
that existing Federal law was inade- 
quate to ensure protection of the 
public health and recommended 
new legislation to require premarket 
safety testing for chemicals. Testi- 
mony given by representatives of 
the National Cancer Institute rec- 
ommended careful testing for 
cancer-causing properties prior to 
approving the use of chemicals in 
food. 

In 1958, the Congress added the 
so-called “Delaney Clause” to the 
food and drug law. This clause 
states very simply that no additive 
shall be approved for use in food if it 
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has been found after testing to in- 
duce cancer in man or animals. The 
heart of the Delaney Clause centers 
on the “zero-risk’”’ concept. Once a 
food additive has been determined 
to be a carcinogen, use of the 
substance must be banned. Despite 
the fact that this provision of the 
law has only been invoked twice, it 
has become the source of consider- 
able controversy, an emotional 
issue, and a target for change. The 
major reasons for this center on 

e the lack of regulatory options 
once a food additive has been deter- 
mined to cause cancer; 

e the belief that health, economic, 
or other benefits resulting from the 
use of a cancer-causing food ad- 
ditive might in some cases outweigh 
the risks associated with its use; 

® concern about current testing 
methods and the extent to which 
they are valid and accurate predic- 
tors of the cancer-causing potential 
of a food additive in humans; and 

® recent advances in analytical 
techniques which can now detect 
extremely minute quantities of 
cancer-causing substances in food, 
something not possible when the 
Delaney Clause was enacted. 


Bacon or Botulism? 


The use of nitrite probably best il- 
lustrates the potential effect of the 
“Deianey Clause.” About 6.8 billion 
pounds of pork, 2.6 billion pounds of 
beef, and substantial quantities of 
fish containing nitrite are processed 
annually in the United States. Nitrite 
is used to inhibit the development of 
botulism, a deadly toxin responsible 
for food poisoning. For thousands 
of years, people have been eating 
meat cured with salt. Early users did 
not realize that nitrate, present as a 
natural impurity in salt, was a key in- 
gredient in the process. Scientists 
in the early 1900’s determined that 
some of the nitrate in salt was 
changed to nitrite in the meat and 
that the nitrite reacted with the 
meat to produce the desired effects. 


Today most curing is done by add- 
ing nitrite directly to food products. 
Nitrite is used extensively in proc- 
essed meat (e.g., bacon, sausage, 
canned ham, frankfurters, poultry, 
fish, imported cheese, and pet food). 


Since the late 1960’s, scientists 
have known that both before and 
after ingestion, nitrite can combine 
with other chemicals, called amines 
or amides, to form a family of chemi- 
cal substances known as nitros- 
amines, which are among the most 
potent carcinogens known. Nitros- 
amines at any level are not permit- 
ted to be knowingly added to food. 
However, FDA and USDA do allow 
the addition of nitrite to many foods. 
Since amines capable of combining 
with nitrite are normal components 
of food, the combination of nitrite 
and food amines to form nitros- 
amines can occur in food before or 
after ingestion. It is therefore likely 
that many foods, including cured 
meats, contain detectable amounts 
of potentially carcinogenic nitros- 
amines. Because nitrite was not 
believed to cause cancer directly, 
however, FDA was not required to 
ban it. 

In 1979 and 1980, studies con- 
ducted at MIT raised serious ques- 
tions that nitrite by itself might be a 
carcinogen. Faced with this possi- 
bility, FDA had a serious regulatory 
dilemma—to ban the use of nitrite 
and face the devastating effect on 
the meat processing industry, since 
there is no substitute for nitrite, or 
to allow the use of a carcinogen ina 
large portion of the food supply. 
Critical review of the MIT study 
determined that it was invalid, and 
FDA was not forced into making this 
difficult decision. 


Improved Tests 
Produce Dilemma for 
Policymakers 


Two of the biggest problems fac- 
ing the FDA are defining zero risk 
and determining whether zero risk is 
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attainable. When the Delaney 
Clause was passed in 1958, scien- 
tists were able to detect the 
presence of substances in the parts- 
per-million range. Today, scientists 
can detect substances in the parts- 
per-billion and even in the parts-per- 
trillion range. 

This increased ability to find min- 
iscule portions of harmful sub- 
stances in food has created obvious 
problems for decisionmakers. Con- 
siderable debate is taking place 
over the effect such small amounts 
of harmful substances can have on 
the human system. As more and 
more is learned about cancer and 
carcinogens, the situation becomes 
increasingly complicated. 

For example, it is now believed 
that not ail carcinogens are of equal 
potency. Asbestos and aflatoxin, a 
mold which occurs in peanuts, are 
considered strong carcinogens 
while others, such as saccharin, are 
considered weak. In addition, some 
scientists believe that certain 
substances cause cancer directly 
while others must interact with an- 
other substance to produce a 
carcinogenic response (co- 
carcinogens), and still others are 
cancer promoters but do not cause 
the disease by themselves. 

To compound the situation, scien- 
tists disagree among themselves on 
whether consumption of a cancer- 
causing substance will always trig- 
ger a carcinogenic event or whether 
there exists some level of ingestion 
or threshold below which no such 
eveni will occur. Add to this the 
variety of potentially harmful sub- 
stances in the air we breathe and 
the water we drink, many of which 
could conceivably interact in some 
kind of synergistic fashion, and we 
could easily be influenced into flee- 
ing to some deserted island where 
we could escape the pollutants pro- 
duced by our modern-day society. 


No Easy Answers 


To determine whether food ad- 
ditives cause cancer and to assess 
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their risk to humans, scientists have 
developed a variety of tests. None, 
however, are considered to be to- 
tally reliable. Several types of 
studies or analyses are used only as 
indicators of a substance’s cancer- 
causing capability. 

Information about a substance’s 
cancer-causing ability can be ob- 
tained by comparing its chemical 
structure with related chemicals. 
Results from these analyses are not 
regarded as strong indications of 
either safety or risk. 


Short-term screening tests are 
based on the presumption that 
cancer is related to changes in cells, 
which can result in mutations. There 
are now about 100 different such 
tests, but none can detect every car- 
cinogen. Many scientists have rec- 
ommended using a battery of 
short-term tests to detect sub- 
stances that cause cancer in 
humans. However, no generally ac- 
cepted group of tests exists. The 
greatest advantage of short-term 
tests is that they can be conducted 
in 2 or 3 weeks and are relatively in- 
expensive. 


Animal studies are generally con- 
sidered the best method available 
for evaluating a substance’s cancer- 
causing potential. Test animals, 
usually rodents, are exposed to sev- 
eral dose levels of the test sub- 
stance over their lifetimes. These 
animals are compared to a control 
group which is not exposed to the 
substance. The ability of a sub- 
stance to cause cancer is measured 
by the increased incidence of can- 
cer, if any, in the exposed animals 
compared to the control animals. 

Questions have occurred about 
the appropriateness of using 
animals to assess a substance’s 
cancer-causing ability in humans. 
Critics of animal tests argue that 
man is not a big rat and that 
e doses of substances to which 
test animals are exposed (maximum 
tolerated dose) are too high and not 
predictive of the effects of human 
exposure, 


® some animals used for testing are 
so biologically different from 
humans that results from them have 
no value, and 
¢ some animals (or organs of test 
animals) are extremely sensitive to 
cancer-causing substances. 
Positive results from human epi- 
demiological studies (for example, a 
comparison of cancer incidence be- 
tween asbestos workers and other 
groups) are the most convincing 
evidence of a substance’s car- 
cinogenic potential in humans. By 
their nature, however, these studies 
are retrospective since intentionally 
exposing people to a potential car- 
cinogen is unethical. Because it is 
generally believed that cancer takes 
a long time to develop, exposure to 
a cancer-causing substance will 
usually not show any immediate 
results. Epidemiological studies 
can rarely provide timely answers to 
regulatory problems. Such studies 
take years to perform. 


Human Risk 
Assessment 


In the concept of food safety deci- 
sions, human risk assessment is an 
estimate of the chance that bad 
health will result from using a food 
ingredient.5 Human risk assessment 
techniques are, to a great extent, 
based on the assumption that chem- 
icals which are carcinogenic in test 
animals are also carcinogenic in 
humans. The two steps in risk 
assessment involve 
e extrapolating the results of high 
doses of the test substance in ani- 
mals to low doses of the test sub- 
stance in animals, which requires 
using one of several mathematical 
models and ‘ 

e extrapolating from low-dose ani- 
mal data to corresponding human 
exposure. 

The choice of the mathematical 
model is crucial to the outcome of 
low-dose extrapolation. Dijferent 
models produce widely varying 
results, which may differ by many 
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orders of magnitude at low-dose 
levels. The variances involved in ex- 
trapolating from high-dose animal 
experiments to low-dose risk to 
humans may be illustrated by the 
National Academy of Sciences 
report on saccharin. This report con- 
cluded that, if all 220 million 
Americans alive today consumed 
one bottle of diet soft drink per day 
for the rest of their lives, between 
0.22 and 1,144,000 cases of bladder 
cancer could result over the next 70 
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to 80 years, depending on the 
mathematical model used. All 
estimates were derived from the 
same set of experimental data on 
rats.6 

In summary, there are no simple 
solutions to determine whether a 
substance causes cancer. Each 
step in testing a food additive in- 
volves uncertainty. Scientific meth- 
ods and analyses do not always 
yield a single incontrovertible 
answer. 


The goal of zero risk from cancer 
caused by food additives, while 
highly desirable, may not be viable. 
Minute quantities of carcinogens in 
the food supply may be impossible 
to avoid. If the concept of zero risk 
is to be revised, the Congress will be 
forced to address difficult policy 
issues, such as what is an accept- 
able level of risk, and carefully fac- 
tor this into future decisionmaking 
frameworks. 








Method 


Molecular 
structure 
analysis 


Bioassay 


Epidemi- 
ologic 


Types of Tests Available to Determine Properties Related to Carcinogenicity 


Organism 
used 


“Paper 
chemistry” 


Basic 
laboratory 
tests 


Bacteria, 
yeast, 
cultured 
cells, 
intact 
animals 


Intact 
animals 
(rats, 
mice) 


Humans 


Time 
required 


Days 


Weeks 


Generally 
few weeks 
(range 1 
day to 8 
months) 


2to5 
years 


Months 
to 
lifetimes 


Basis 
for test 


Chemicals with 
like structures 
interact simi- 
larly with DNA 


Chemical inter- 
action with 
DNA can be 
measured in 
biological 
systems 


Chemicals that 
cause tumors in 
animals may 
cause tumors in 
humans 


Chemicals that 
cause cancer can 
be detected in 
studies of human 
population 


Result 


Structure resembles 
(positive) or does 
not resemble 
(negative) 

structure of known 
carcinogen 


Chemical causes 
(positive) or 

does not cause 
(negative) a response 
known to be caused by 
carcinogens 


Chemical causes 
(positive) or does not 
cause (negative) 
increased incidence of 
tumors 


Chemical is associ- 
ated (positive) or is not 
associated (negative) 
with an increased 
incidence of cancer 


Conclusion, if 
result is positive 


Chemical may be haz- 
ardous; that deter- 
mination requires fur- 
ther testing 


Chemical is recog- 
nized as a potential 
carcinogen 


Chemical is recog- 
nized as a carcinogen 
in that species and as 
a potential human 
carcinogen 


Chemical is recog- 
nized as a human 
carcinogen 


Source: Office of Technology Assessment, “Assessment of Technologies for Determining Cancer Risks 
From the Environment,” June 1981, p. 114. 
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Is the Rat an Ideal Experimental Model for Man?' 


PROS 
Has been widely studied 
Is small in size (housing) 
Produces offspring rapidly 
Has brief gestation period 
Grows rapidly to maturity 
Has short lifespan 
Eats any sort of food 
Accepts a dry diet 


Involves low initial and 
maintenance cost 


Is docile 


There is no better alternative 


CONS 

Lacks gall bladder 

Has multiple breasts for feeding 

No emetic reflex 

Normally bears multiple offspring 

Is noctunal 

Is cannibalistic 

Feeds on dung 

Subject to spontaneous tumors 

Requires careful handling— 
temperature, humidity, and noise 
must be carefully controlled 

Has certain nutritional requirements 
for vitamins, minerals, and 


amino acids which must be met 


Is fur-bearing 


™Man Is Not A Big Rat,” Dr. Bernard L. Oser, presented to Tox- 
jocology Forum, February 16, 1987. 











‘On December 11, 1981, GAO issued 
“Regulation of Cancer-Causing Food Ad- 
ditives—Time For A Change?’’ (HRD-82-3). 
Information in this article is drawn, to a 
large extent, from that report and documen- 
tation supporting it. 

Food Safety, Where Are We?’’, Senate 
Committee on Agriculture, Nutrition and 
Forestry, July 1979, p. 11. 

s“Risks vs. Benefits: Future of Food 
Safety,’’ 17th Annual Underwood-Prescott 
Memorial Symposium. 

‘HRD-82-3, Dec. 11, 1981, p. 3. 

5Principles and Process for Making Food 
Safety Decisions, Report of the Social and 
Economic Committee of the Food Safety 
Council, Dec. 13, 1979, p. 27. 

®Saccharin: Technical Assessment of 
Risks and Benefits, Report No. 1. National 
Academy of Sciences, November 1978. 
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Common Misconceptions 
About Pension Plans 





The General Accounting Office 
has had an actuarial staff since 
1969. Over the years, we have 
worked on projects involving pen- 
sion plans and insurance, including 
the earnings test for Social Security 
benefits (Human Resources Divi- 
sion), early retirements under the 
Civil Service Retirement System 
(Federal Personnel and Compensa- 
tion Division), the pension cost 
associated with closing military 
facilities (the former Logistics and 
Communications Division), and fi- 
nancial reporting for Federal pen- 
sion plans (Accounting and Finan- 
cial Management Division and Fed- 
eral Personnel and Compensation 
Division). We have also worked with 
many Department of Defense and 
Department of Energy auditors on 
the pension costs charged to 
Government contracts. Although | 
have been impressed with the ag- 
gressive way auditors, accountants, 


and evaluators have attacked com- 
plex pension problems, their per- 
sistence in maintaining some 
misconceptions about pension 
plans has been frustrating. | hope 
this article will dispel some of these 
myths. 


Misconception 1 


There is a single correct pension 
cost for a given pension plan for a 
given year. 


This is an important misconcep- 
tion because it fosters others. It im- 
piles that there is only one accept- 
able actuarial method and a single 
correct set of actuarial assump- 
tions. | sympathize with those who 
wish the statement above were cor- 
rect because it would make the 
auditing of pension cost much 
easier. Unfortunately, there are a 
variety of acceptable actuarial 
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assumptions, several acceptable 
actuarial methods, and different 
amortization periods to pay for cer- 
tain pension liabilities. Also, for 
most actuarial methods and for 
most pension plans, cost can be ex- 
pressed either as an annual dollar 
cost per participant or as a percent- 
age of payroll. Needless to say, all 
of the above options can have a 
substantial effect on pension cost 
for a given year. 

As this misconception is gradu- 
ally dispelled, it is important not to 
let the pendulum swing too far the 
other way. The converse of Miscon- 
ception 1 is not true. There are incor- 
rect costs for a given pension plan 
for a given year. Cost Accounting 
Standards 412 and 413 restrict the 
range of possible pension costs for 
Government defense contracts and 
reflect a compromise between the 
desire of consulting actuaries 
employed by the contractors for 
complete flexibility and the desire 
of Government auditors for the ab- 
solute rigidity of a single correct 
pension cost. 

An analogy can be made between 
pension costs and depreciation. 
There are a variety of acceptable 
depreciation schedules for capital 
assets. The method of depreciation 
chosen depends on many factors, 
such as usage, obsolescence, cost 
of repairs, and patterns of revenue 
resulting from the asset. A like 
number of factors affect the choice 
of actuarial methods and assump- 
tions. 


Misconception 2 


The accrued benefit actuarial cost 
method is the only proper method to 
determine pension cost for a certain 
period of time. 


This misconception is popular 
probably because the accrued bene- 
fit method is easiest to use. An in- 
dividual’s ability and willingness to 
understand one actuarial method, 
however, should not be the criterion 
by which the method itself is 
judged. For many pension plans, in 


fact, the accrued benefit method is 
not recommended because the ben- 
efit formula makes it difficult to de- 
cide what benefit an individual actu- 
ally accrues in a given year. The 
truth is that all the generally ac- 
cepted actuarial methods are good 
for some situations, and some actu- 
arial methods can be used in any 
situation. 

Under the accrued benefit method, 
enough money is set aside each 
year to pay for the benefit that each 
employee has earned in that year. 
Other actuarial cost methods in- 
volve the more complicated process 
of projecting each participant’s 
benefit at retirement and then fund- 
ing toward the cost of the projected 
benefits of all participants. These 
methods require equating a stream 
of benefit (and expense) payments 
with a stream of employer and em- 
ployee contributions with allowance 
for the pension fund itself. 


Misconception 3 


Changes in actuarial assumptions 
are a sign that the actuary did not 
make a good choice of actuarial 
assumptions originally. 


Circumstances change, and actu- 
arial assumptions must be reviewed 
constantly. This is particularly true 
of any economic assumptions, 
those assumptions relating to in- 
terest rates, rates of salary in- 
crease, and cost-of-living ad- 
justments. An evaluator should be 
more concerned about costs for a 
pension plan whose assumptions 
have not changed for several years 
than for one whose assumptions 
change frequently. 


Misconception 4 


The problem of projecting future ex- 
perience can always be solved by 
collecting more and more informa- 
tion about what has happened in the 
past. 


Actuarial projections are based 
on assumptions about future 


events. The assumptions pertain to 
rates of mortality, disability, termi- 
nation, retirement, recovery from 
disability, salary increase, invest- 
ment earnings, and others. The term 
assumption is a misnomer because 
actuaries base factors on ex- 
haustive statistics compiled from 
individual plans and pooled data 
from many plans. Statistics are the 
lifeblood of the actuarial profes- 
sion, and | do not wish to underrate 
their value. However, neither the 
lack of sufficient data nor the un- 
availability of accurate data is a 
common reason for inaccurate ac- 
tuarial projections. In doing ac- 
tuarial work for GAO over the past 9 
years, | have seen many projections 
that did not resemble the ensuing 
experience. All of the following 
causes were much more common 
reasons than insufficient data: 

e Too many data on too many dif- 
ferent aspects of past experience 
or, more properly, the inability of the 
estimator to analyze correctly which 
aspect of past experience was go- 
ing to be the most significant deter- 
minant of what would happen in the 
future. 

e Outside influences on the projec- 
tion by a party or parties wanting 
the estimate to show a desired 
result. 

e Unforeseen events, such as the 
discovery of penicillin, the oil em- 
bargo, strikes, or failures to renew 
Government contracts. 

e Unpredicted and unpredictable 
variations in experience over time 
due to statistical fluctuation or 
other unknown causes. (Actuaries 
have been known to Say, ‘“‘My projec- 
tion was good, but the experience 
was bad.”’) 


Misconception 5 


The interest rate assumption used 
in an actuarial valuation to discount 
future benefit payments and other 
cash flows should closely resemble 
the investment earnings rate of the 
fund in the last 2 or 3 years. 


The interest rate is generally the 
most important single assumption 
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in the actuarial valuation of a pen- 
sion plan. A 1-percent change in the 
interest assumption can change the 
pension cost for the current year by 
as much as 25 percent. 

Because a pension plan is a long- 
range operation, however, an ac- 
tuarial valuation considers benefit 
payments to be made over a period 
of 60 years or more. Therefore, the 
interest rate used in an actuarial 
valuation must discount liabilities 
for a long period of time. In deter- 
mining the interest rate, actuaries 
prefer to study economic trends 
over a long-range period rather than 
just immediate past history. 

The swings in pension cost that 
would result from monitoring very 
recent investment experience would 
make the task of budgeting pension 
costs chaotic. This is particularly 
true with the recent volatility of in- 
terest rates. Eliminating the peaks 
and valleys in pension costs must 
be recognized as a valid goal of ac- 
tuarial funding. 

Frequently, the investment ex- 
perience of a particular pension 
fund is less important than the ag- 
gregate investment experience of a 
group of pension funds. Funds with 
unfavorable investment experience 
frequently change asset managers, 
which invalidates, to a great extent, 
their own individual experience. 


Misconception 6 


Computers make it possible to ob- 
tain the results of any actuarial cal- 
culation almost instantaneously. 


The misleading words here, of 
course, are “any” and “instantane- 
ously.” Although it is a constant 
companion of the actuary, the com- 
puter does have its limitations. 

Many of the approaches we take 
to our work would be impossible, or 
at least impractical, without com- 
puters. They are very valuable in 
operations which involve repeating 
a certain type of calculation (for ex- 
ample, calculating the value of an 
annuity with several different in- 
terest rates) and in solving problems 
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which lend themselves to solutions 
by existing programs. 

Computers are less helpful, how- 
ever, for solving new problems. After 
all, a computer can do only those 
things for which a human being pro- 
grams it. A computer is not much 
use, for example, when a job entails 
scanning reams of data, none of 
which is exactly suitable to the 
problem at hand. 


Misconception 7 


Every pension plan participant has 
an account in the pension fund, and 
a certain portion of the assets are 
allocated just for the individual par- 
ticipant. 


Almost all pension plans, par- 
ticularly the large ones, have pen- 
sion funds whose assets are unallo- 
cated. This is true whether or not the 
plan is contributory. When employ- 
ees leave their jobs and receive a 
termination benefit, they are not 
withdrawing something from their 
own account. They are instead re- 
ceiving a benefit under pension plan 
provisions which specify what 
withdrawals employees are entitled 
to. 


kk * 


Some of you reading the seven 
deadly misconceptions about pen- 
sion plans will recognize your- 
selves. Be assured that you are not 
unique victims of these misconcep- 
tions. You are probably in the 
minority of the general population 
who have given any thought at all to 
this subject. | am afraid the popu- 
larity of these misconceptions tells 
us something about the ability and 
willingness of actuaries to com- 
municate what they have learned in 
the specialized field of pension 
funding. 

Happily, the situation is chang- 
ing. More articles on the subject of 
pensions are being written by actu- 
aries and others with an under- 
standing of pensions instead of 
self-styled pension experts whose 


inaccurate and misleading state- 
ments have caused the problems. 
Actuaries are communicating more 
about what they do and why they do 
it. 

The GAO Actuarial Staff stands 
ready to discuss pension problems 
with auditors/evaluators/account- 
ants. We respect the determina- 
tion, energy, and aggressiveness 
with which you approach your work, 
and we are willing to confront the 
stubborn streak that so frequently 
accompanies these attributes. 
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Teamwork Triumphs 
Over Murphy’s Law 











Murphy’s law warns us that if any- 
thing can go wrong, it will. Recently, 
a GAO-led interagency team effort 
demonstrated that teamwork, while 
it will not stop Murphy’s law from 
working, can overcome its effects. 

The team’s assignment was to 
evaluate the implementation of the 
Safe Drinking Water Act and test 
certain ‘‘key wells” on the Navajo In- 
dian Reservation for harmful con- 
tamination. The three congressional 
committees that requested the 
evaluation were particularly con- 
cerned about possible radionuclide 
contamination in a number of the 
tribe’s drinking water wells. 
Because of this concern, they put a 
high priority on the request and 
wanted a report in 6 weeks. 

Already the assignment’s request 
and reporting requirements _in- 
dicated that we could expect more 
than the usual types of problems 
and challenges in doing the job. For 


one thing, we needed expert tech- 
nical assistance, and secondly, the 
deadline was impossible. In addi- 
tion, since the Navajo Indian Reser- 
vation is the largest reservation, it 
posed transportation and logistics 
problems; it covers about 25,000 
square miles in Arizona, New Mex- 
ico, and Utah (about the size of West 
Virginia—see map). The 155,000 
Navajo people are scattered all 
around the reservation, with many 
located in remote areas miles from 
established communities. Similarly, 
the water supplies are at remote 
locations all around the reservation. 

Teamwork began when, in coor- 
dination with the requesting com- 
mittees, we developed a reporting 
plan and arranged for needed tech- 
nical support. The committees 
agreed to a two-phased review that 
would first look at their key concern 
over radionuclide contamination 
and report the results in 6 weeks, 


GAO Review/Spring 1982 








Teamwork Triumphs Over Murphy’s Law 


LOCATION OF PUBLIC WATER SUPPLIES AND WELLS GAO SAMPLED ON THE NAVAJO INDIAN RESERVATION 























NEW MEXICO 
































and then evaluate the overall drink- 
ing water program and test supplies 
for other possible contaminates. To 
support our effort, the committees 
arranged for technical support from 
the Environmental Protection Agen- 
cy (EPA), the U.S. Geological Survey 
(USGS) and the Department of 
Energy (DOE). In addition, since the 
only possible way to cover the reser- 
vation in the time allowed for the 
first phase was to use helicopters, 
the committees arranged for the 
Bureau of Indian Affairs (BIA) to pro- 
vide two helicopters to support the 
taking of water samples. 

We fully realized that even with 
the cooperation and assistance of 
the committees, problems and chal- 
lenges would be ever-present on this 
effort. And, while it is not practical 
to review in this article each such in- 
stance that occurred, the following 
are instances in the two phases of 
the review where teamwork was par- 
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ticularly useful in minimizing the ef- 
fects of Murphy’s law. 


Phase I 


This phase, which was during the 
summer, was to sample wells at 16 
locations for possible radionuclide 
contamination. 


Lining Up Laboratories 


The first Murphy’s law problem 
developed when we were lining up 
three laboratories to analyze the 
first phase water samples for ra- 
dionuclide contamination. One of 
the commercial laboratories we 
wanted had previously analyzed 
water samples from the reservation. 
We asked the Federal agency that 
had a contract with this laboratory 
to arrange for it to process a set of 
our samples. Some agency officials, 
however, did not want to provide the 


Support because they could not 
control our use of the results. This 
problem with the agency, along with 
the fact that we did not have time to 
contract directly with the laboratory 
for its services, was brought to the 
attention of the committees. They 
interceded and arranged for the 
agency to provide the needed sup- 
port to process the samples. 
Murphy’s law struck again when 
the arrangements with the labs were 
being completed. We learned that 
all the laboratories could do by our 
July 31 deadline was a “screening” 
analysis, which would only deter- 
mine the gross radioactivity of the 
samples. Full analyses to identify 
the specific radioactive contami- 
nates would have required another 2 
months to complete. This extra time 
was needed due to the large number 
of samples involved (about 75 for 
each laboratory). When informed of 
the problem, the committees under- 
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stood and agreed to accept only the 
screening results by the July 31 
date, but they still wanted the de- 
tailed analyses as soon as these 
were available. 


Obtaining Containers 


We needed containers for the 
water samples. The containers had 
to be new, plastic 1-gallon con- 
tainers acceptable to the labs for 
radionuclide sampling of drinking 
water. 

The USGS water technician said 
USGS would furnish the containers, 
shipping cartons, equipment, and 
supplies for phase | sampling. The 
preferred containers were to be 
shipped to Denver from Washing- 
ton, D.C., and the technician was to 
bring them with him to the reserva- 
tion. Because of a nationwide truck- 
ing strike, we were concerned about 
the shipment and availability of the 
containers and followed up to be 
sure the containers would arrive on 
time. The USGS water technician 
was confident that the containers 
would arrive on time because they 
were being shipped by airfreight. In 
addition, he indicated that accept- 
able but less durable containers 
were available in Denver, if the 
planned containers did not arrive. 

On Friday afternoon, 3 days 
before the sampling was to start, 
Murphy’s law struck. The USGS 
technician called from Denver with 
the bad news that the containers 
had been held up; he said they were 
sent by airfreight but were mis- 
routed to Chicago. As a result, they 
would not be available until 2 days 
after the sampling was to begin. He 
suggested delaying sampiing for a 
week, but this wasn’t practical be- 
cause the rest of the sampling team 
had already left for the reservation 
and our deadline would not accom- 
modate a delay. 

To cope with the situation, we 
asked the technician to bring the 
backup supply of containers that 
was supposed to be in Denver. 
Murphy’s law struck again when, in 
ordering the 250 containers (includ- 


ing 10 percent spares), the tech- 
nician was able to get only 125 and 
no shipping cartons. 

We learned that another tech- 
nician, working for DOE, had a sup- 
ply of containers at his laboratory, 
and knowing that he had not yet left 
for the reservation, we called him to 
see if DOE could supply some con- 
tainers. He said that DOE could pro- 
vide 100 containers, also without 
shipping cartons. He promised to 
bring 50 initially and the other 50 
when he returned to take the first 2 
days’ samples to the DOE lab for 
processing. In total, 225 containers 
were lined up, just enough for the 
sampling effort with no spares. 

The next day, courtesy of Murphy’s 
law, the DOE technician called to 
say that he had the 100 containers 
but no lids—meaning that we were 
back to only 125 usable containers. 
He said that he would continue look- 
ing for the lids, but suggested that 
we look for some, too, if we still 
wanted DOE’s containers. We said 
that the containers were needed 
and agreed to look for some lids. We 
notified the USGS technician about 
the lid problem, and he said that he 
would coordinate with the DOE 
technicians since they were in the 
best position to solve the problem. 
He said that somehow they would 
get the needed lids. The USGS and 
DOE technicians both worked to 
find lids, and when they arrived on 
the reservation, they each brought a 
supply of lids—we had a double 
supply of lids. 


Rounding Up Shipping 
Cartons 


The problem caused by misrouting 
the containers also resulted in a 
lack of shipping cartons. Out on the 
Navajo reservation there was no 
commercial source for shipping car- 
tons. We discussed the problem 
with the tribe and BIA representa- 
tives that were supporting the team, 
and both offered to try to locate 
some cartons. The BIA representa- 
tive took the lead and said he would 
see if BIA might have the needed 


cartons in a nearby warehouse. He 
obtained a requisition form from his 
office and went to the warehouse 
with a GAO team member, where 
they found that suitable cartons 
were in stock but committed for 
another use. The BIA representative 
explained the priority of our need to 
the warehouse supervisor and even 
agreed to get someone from his 
department to do some needed 
maintenance at the warehouse, if 
they would give us the cartons. 


Making Shipping 


Arrangements 


We knew that there might be prob- 
lems in shipping the samples from 
the reservation to the laboratories 
and addressed them before starting 
the sampling. Because of the 
remoteness of the Navajo reser- 
vation, our base of operations was 
200 miles from one laboratory and 
more than 800 miles from the other 
two. In addition, the nearest loca- 
tion from which the samples could 
be shipped on an expedited basis 
was Albuquerque, New Mexico, 150 
miles from our base of operation. In 
addition, as Murphy’s law would 
have it, the fact that a small amount 
of acid was used to preserve some 
samples caused a problem in finding 
a permissible mode of transporta- 
tion. 


We discussed the transportation 
problem with EPA, USGS, DOE, tech- 
nicians, the laboratories, the Depart- 
ment of Transportation (DOT), and 
various airlines and freight com- 
panies. The DOE technician said he 
would transport some samples to 
the DOE laboratory (200 miles) for 
us. This meant we needed only to 
make arrangements for shipping the 
other samples to the other two lab- 
oratories. 


In researching the matter to deter- 
mine the legalities of shipping the 
acidified samples to the other two 
laboratories, we got more confusion 
than clarification. We did learn that 
EPA had an agreement with DOT that 
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allowed EPA to airship similarly pre- 
served samples, but we were not 
sure if we could work under this 
agreement. EPA said that we could 
refer to its agreement with DOT 
when trying to make _ shipping 
arrangements. By referencing the 
EPA/DOT agreement, we were able 
to complete arrangements with an 
airfreight company and airship the 
samples from Albuquerque to San 
Francisco, where the other two 
laboratories were located. 


Selecting Wells To Be 
Sampled 


We made a tentative selection of 
wells for sampling and sent the list 
to the tribe and the responsible 
agencies ahead of time, so they 
could arrange for us to sample the 
wells. However, Murphy’s law struck 
again: the committees got word that 
someone may have tampered with 
some of the wells on the list in an at- 
tempt to distort the results of our 
sampling. 

To reduce the effects of any 
tampering, we agreed to alter the 
sampling plan. We amended our 
selection and added some wells 
that would be disclosed with a 
minimum of advance notice. Also, 
based on a consultant’s advice, our 
sampling plan was already set up to 
sample each well twice (2 days 
apart). By sampling twice, we could 
detect unusual changes in the con- 
tamination levels that would likely 
result from any tampering. 


The possible tampering problem 
made the team more alert to the 
need for good controls, both in the 
site selection and over the samples. 
The samples were randomly num- 
bered from a control log, and they 
were kept in the possession of a 
GAO team member at all times until 
they were shipped to the laborato- 
ries. The sampling technicians were 
also concerned and worked with 
the GAO team members to control 
and assure the integrity of the 
samples. 
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The team that beat Murphy’s law, at Church Rock, New Mexico. 


Coordinating Helicopter 
Support 


The only way to cover the large 
reservation in the short time was to 
use helicopters provided to us by 
BIA. However, as Murphy’s law 
would have it, two competing heli- 
copter contractors were not overly 
friendly toward each other. We 
were concerned because we needed 
teamwork, particularly since only 
one operator was furnishing a fuel 
truck and both aircraft needed fuel 
support away from our base of 
operations. With the use of a little 
SPCD,' we were able to get the two 
pilots to work together as a team to 
provide the needed fuel support for 
both helicopters. In fact, during the 
project the mechanic/fuel truck 
driver voluntarily pitched in to help 
with some of the maintenance on 
the other contractor’s helicopter. 

The helicopters did not solve all 
our transportation problems. In 
figuring the weight of the water 
samples (about 10 pounds each), 
the elevation of the well sites, and 
the fuel ranges of the two heli- 
copters, we realized that in addition 


to having to be refueled in the field, 
the helicopters could not carry a full 
day’s samples. As a result, we ar- 
ranged a sampling schedule for each 
day so that the helicopters could 
meet the fuel truck and a team mem- 
ber with a van to refuel and drop off 
the samples. Without refueling and 
off-loading the samples in the field, 
much time would have been lost 
returning to the airport at the base 
of operations to refuel and to drop 
off the samples. This would have 
greatly limited the total sampling 
effort. 

On one occasion, because of the 
heat and altitude, one helicopter 
with three team members and a 
heavy load of water samples had dif- 
ficulty getting off the ground. At the 
next location, with an even higher 
elevation and with more samples, 
we were concerned about the pros- 
pects of getting off the ground. A 
water system representative who 
met us at this well, however, pitched 
in to help us reduce the weight by 
driving one of the team members to 
the next location, where another 
team member with the van was wait- 
ing to pick up the samples. 
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Team members preparing to ship water 
samples to the laboratories. 


At another landing spot, both 
helicopters were surrounded by 
about 25 Indians after the team 
leader and tribe representative went 
to locate the well. The pilots and 
four other team members, who re- 
mained with the helicopters, became 
a little nervous as the crowd grew, 
since they knew the people in the 
area had not been told about our ac- 
tivities. The apparent leader of the 
group would only say, “we watch, 
we wait” when the team tried to talk 
to them. Upon returning to the heli- 
copters, the tribal representative 
satisfied the crowds’ concerns by 
explaining our activities to them in 
Navajo. In addition, the tribal repre- 
sentative greatly assisted us by ob- 
taining information, explaining the 
reservation’s water supplies, and 
gaining the cooperation of local 
authorities. 


Collecting the Water 
Samples 


Murphy’s law met our sampling 
technicians at one well head-on, 
when a waterline broke and soaked 
them with water. They didn’t let the 
soaking stop them; they collected 
the sample and spent the rest of the 
day drying out. Luckily, the day was 
hot and the dampness was even a 
little refreshing. They said it felt like 
taking a shower in their clothes, 
since the water was naturally warm. 

At a few wells, Murphy’s law com- 
plicated things by the fact that taps 
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were not available to take the 
samples. Where there were no taps, 
the technicians collected the sam- 
ples from the nearest taps on the 
distribution system even though the 
results were not considered as 
valid. After discussing the problem 
with tribe officials, they arranged to 
have taps installed on all the wells 
for the second round of sampling. 


Phase II 


This phase, which was conducted 


A well at Monument Valley, Arizona. 


during the fall, entailed evaluating 
(1) the implementation of the Safe 
Drinking Water Act on the reserva- 
tion and (2) sampling selected water 
supplies for bacterial, inorganic, 
and organic contaminants. The 
problems experienced were similar 
to those in phase I. 


Lining Up Laboratory 
Support 


As with phase |, we lined up ap- 
propriate laboratories to analyze 
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A modern pump used in the sampling. 


water samples (three for each type 
of contaminant). On Friday after- 
noon, 3 days before we were to start 
sampling, Murphy’s law struck 
again. One of the labs called to say 
that it could not run our samples be- 
cause its only qualified chemist had 
just resigned. It was too late to 
change our sampling schedule, and 
the samples for that lab were to be 
collected on Monday and delivered 
Tuesday. This meant that, if the 
samples were to be analyzed, a 
team member would have to arrange 
for another laboratory and make 
shipping arrangements while the 
samples were being collected. The 
team member, with the cooperation 
of USGS and BIA, arranged to send 
the samples to a USGS lab in Denver 
for analysis and for BIA to assist 
with the necessary shipping ar- 
rangements. Making the alternate, 
arrangements on such short notice 
was easier because we established 
and maintained contacts with USGS 
and BIA earlier in the assignment. 


Obtaining Supplies and 
Other Support 


For this phase we ordered the 
supplies for the sampling far in ad- 
vance from commercial sources, 
and we were assured that they 
would be delivered on time. With 
Murphy’s law hindering us, we were 
not surprised when only part of the 
supplies arrived on time. As with the 
phase | effort, we had to find alter- 
native supplies. Since the Navajo 
Tribal Utility Authority’s lab was 
already providing laboratory sup- 
port for this phase, they came to our 
rescue and provided substitute sup- 
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This site shows the muddy conditions. 


plies when the ordered supplies ar- 
rived a few days late. 

The Tribal Utility Authority’s lab 
was an important part of the team 
during phase Il. In addition to assist- 
ing with the containers, the labora- 
tory helped with preparations for 
sampling (including control samples) 
provided technical assistance, and 
furnished miscellaneous supplies, 
such as acids for preserving the 
water samples, special shipping 
cartons which could not be pur- 
chased in time for the effort, and a 
pH meter for measuring the acidity 
of the water. The laboratory even ac- 
cepted as a natural result the pH 
meter’s becoming a casualty of 
Murphy’s law: after a couple of days 
of working fine, the cold and/or 
vibrations in the four-wheel drive 
vehicle got to the pH meter, and it 
started faltering and finally died on 
the last day of sampling. 


Handling the Weather 
Problems 


Since the season was fall, we had 
snow, rain, and cold weather to con- 
tend with. At sampling sites, the 
conditions were often muddy and 
wet, and collecting the samples ata 
few sites meant standing in slippery 
mud and, on one occasion, in ankle- 
deep cold water. In spite of the con- 
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ditions, the team worked together to 
complete the sampling as quickly 
and efficiently as possible. The 
tribal representative who supported 
us in both phases was right in there 
doing his part to assist—he drove 
the four-wheel drive vehicle, located 
the selected sampling sites, helped 
with the quality control of the sam- 
ples, carried samples and other 
materials, and operated well equip- 
ment where necessary. 


Overview Assessment 


Interagency teamwork worked 
well for this review of drinking water 
on the Navajo Indian Reservation. It 
was the key to our success in 
meeting the committees’ request 
and beating Murphy’s law. Many of 
the team members put in long hours 
and all coordinated well to get the 
job done. As indicated earlier, the 
team included the committees, too, 
whose exceptional cooperation and 
assistance helped pull together the 
laboratories, supporting agencies, 
and the Navajo Tribe—they were all 
essential components of the team 
effort. 





' A GAO training course designed to im- 
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The Case for 
Programwide 


Statistical Reviews of 
Fraud and Abuse 


Reviews of fraud and abuse are 
typically sparked by the suspicions 
and _ intuitions of knowledgeable 
evaluators. If the evaluator’s intui- 
tions are borne out in a small num- 
ber of exploratory sites, the review 
effort is often expanded to addi- 
tional sites likely to evidence the 
suspected problem. This is particu- 
larly true where the primary goal of 
the review is to expose deficiencies 
and deter future infractions of the 
law. One of the pitfalls of this ap- 
proach, however, is the danger of ex- 
trapolating the results of a small- 
scale review to the program as a 
whole. If one of the objectives is to 
be able to say how widespread the 
fraud or abuse is, then a probability 
sample is required. Such a sample 
will represent a cross-section of pro- 
gram sites and participants and will 
include those that are likely to 
evidence the fraud or abuse and 
those for which there are no expec- 
tations prior to data collection. 

It is often more cost effective to 
have a large-scale statistical review 
of the programwide incidence of 
fraud and abuse before devoting 
resources to smaller-scale audits on 
a site-by-site basis. As a case in 
point, this article will discuss a 
Migrant Education Program evalua- 
tion’ sponsored by the Department 
of Education. 

As reducing fraud and abuse in 
Federal programs receives greater 
emphasis, evaluators must consider 
the appropriate scope and objec- 
tives of such efforts. Three objec- 
tives are 
¢ analyzing a program’s vulner- 
ability to fraud and abuse, 

e identifying specific incidents of 
fraud and abuse at selected sites, 
and 

e determining the programwide in- 
cidence of particular types of fraud 
and abuse. 

For some programs, analyzing the 
areas of vulnerability to fraud and 
abuse is a necessary precursor to 


more focused work.? Programs 
which have expanded rapidly and 
have not been able to examine pro- 
gram operations for fraud and 
abuse are prime candidates for this 
objective. An audit of program op- 
erations at selected sites is often 
appropriate where enforcement and 
deterrence are the main goals of the 
review. In some cases, however, the 
crux of the problem is the magni- 
tude of the programwide incidence 
of fraud and abuse; a review based 
on a probability sample of sites and 
participants is appropriate in these 
cases. 


Focus on Specific 
Incidents of Fraud 
and Abuse 


Because of cost and staff con- 
Straints, reviews often focus on 
specific incidents of fraud and 
abuse at a judgment sample of pro- 
gram sites. In such cases, the plan- 
ning phase of the study has typically 
given the evaluator good reason to 
believe that such incidents will be 
easy to find and document. This 
Strategy is particularly appealing in 
cases where the fraud and abuse is 
believed to be blatant. Program 
planners (agency and congres- 
sional) find reviews of specific in- 
cidents useful because they provide 
information on the fraud and abuse 
typical of the program and on the 
operating constraints that could 
limit prevention and detection. If 
similar incidents are found across a 
diverse set of sample sites, the eval- 
uator can put forth a strong hypoth- 
esis (or tentative generalization) 
that these types of incidents are 
common across the set of all pro- 
gram sites.? Armed with this infor- 
mation, program officials can then 
design and implement safeguards 
against continued fraud and abuse 
in the identified areas. 

The decision to look for specific 
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incidents of fraud and abuse at a 
small number of sites is easy to 
justify for several reasons. First, the 
results of the review can often be 
anticipated. Second, locating iso- 
lated examples of fraud and abuse 
in Federal programs is often rela- 
tively easy. The complexity of pro- 
gram regulations and eligibility 
requirements makes identifying po- 
tential sources of fraud or abuse 
and specific examples of their oc- 
currence at program sites fairly like- 
ly. Newspapers may highlight par- 
ticularly sensational cases. Third, 
attaching dollar figures to these in- 
cidents makes the small-scale 
review especially attractive; one can 
speculate that if X percent of the 
population of clients, service pro- 
viders, sites, etc., engages in the 
practice, $X could be saved if the 
practice were stopped. Finally, ina 
specific-incident review, evidence of 
misconduct or illegal behavior can 
be turned over to law enforcement 
authorities for prosecution. 


Focus on 
Programwide 
Incidence of Fraud 
and Abuse 


If, as the preceding section sug- 
gests, there are many advantages to 
small-scale reviews of fraud and 
abuse, then why should we do pro- 
gramwide reviews that are more 
costly and take longer to complete? 
The simple answer is that large- 
scale statistical reviews allow the 
evaluator to estimate the magnitude 
of fraud and abuse in the program 
as a whole and thereby provide the 
answer to the $64,000 question, how 
much of the taxpayers’ money is be- 
ing wasted? This information is vital 
to congressional decisionmakers in 
carrying out their oversight respon- 
sibilities and considering possible 
legislative changes. 
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Unless the overall magnitude of 
fraud and abuse is measured, eval- 
uators run the risk of wasting 
scarce resources on small-scale re- 
views of programs with an overall 
low level of fraud and abuse (al- 
though possibly rich in blatant ex- 
amples of fraud and abuse in se- 
lected geographical areas) and 
ignoring other programs that have a 
higher incidence of fraud and 
abuse. 

An estimate of the magnitude of 
fraud and abuse helps the eval- 
uator develop recommendations for 
bringing the fraud problem under 
control. If the incidence of fraud and 
abuse is large, the evaluator can 
recommend that sophisticated (and 
costly) monitoring systems be 
designed and developed. If the in- 
cidence is low, the evaluator may 
recommend less costly monitoring 
systems, such as better staff train- 
ing, increased technical assistance 
for headquarters and field staff, and 
spot checks by third-party evalu- 
ators. 

Large-scale statistical reviews 
overcome some of the basic weak- 
nesses of smaller scale audits at a 
judgment sample of sites. They 
eliminate the temptation to specu- 
late about the magnitude of fraud 
and abuse in a program based on 
limited data. As many of us have ex- 
perienced, the desire to generalize 
the findings of a small-scale review 
to the program as a whole is irresis- 


tible. After the field work is com- 


pleted and dollar figures are at- 
tached to identified sources of fraud 
and abuse, it suddenly seems per- 
fectly reasonable to conclude that 
$X would actually be saved if the 
identified practices were stopped at 
all program sites. Unfortunately, 
such a conclusion often cannot be 
supported by the sample and the 
data used for the review. Large- 
scale reviews compensate for the in- 
ability of most small-scale reviews 
to differentiate among programs 


with relatively high and low levels of 
fraud and abuse. 


An Example: Funding 
the Migrant Education 
Program 


A Migrant Education Program 
evaluation’ illustrates the value of 
large-scale statistical reviews in 
assessing the nature and extent of 
fraud and abuse in government pro- 
grams. In this case, the problem 
concerned the counting of ineligible 
students which thereby fraudulently 
increased the level of program fund- 
ing which was based on those counts. 
Migrant Education Program offi- 
cials in Washington, D.C., and in 
State departments of education in- 
dicated an awareness of the poten- 
tial for fraud and abuse and sought 
to address the problem through 
technical assistance to sites. If 
pressed, they could probably name 
localities where the problem was 
particularly severe. Migrant pro- 
gram staff also contended, however, 
that large numbers of eligible stu- 
dents were excluded from the counts 
because some State and local of- 
ficials did not put a high priority on 
identifying and enrolling eligible 
students. On the other side, some 
policymakers and officials in other 
education programs claimed that 
the counting of ineligibles was ram- 
pant, and major accountability ef- 
forts were called for. 

Here was a case where a review in 
a judgment sample of program sites 
would not have settled the claims 
made on either side of the issue. Un- 
doubtedly, audit work at a judgment 
sample of. sites would reveal in- 
stances where ineligibles were im- 
properly enrolled on the computer 
system as well as instances where 
eligible children were improperly ex- 
cluded. In the absence of a statisti- 
cal sample, however, the findings of 
the audit work could not be general- 
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ized to the population as a whole. 
Given the controversy surrounding 
the inclusion of ineligibles, even a 
tentative conclusion based on a 
judgment sample of sites would be 
very risky since advocates on either 
side of the issue could bring in 
counterexamples of their own. 

As described below, results of a 
large-scale statistically based 
evaluation of the Migrant Education 
Program indicated that fraud and 
abuse (i.e., counting ineligible 
students and thereby increasing 
program funding) was relatively low. 
Of equal importance, the study in- 
dicated that the overcount of 
students due to the inclusion of in- 
eligibles was offset by an under- 
count of eligible children. The 
undercount occurred as a result of 
the program’s failure to (a) count 
identified migrant children for their 
full eligibility period and (b) identify 
all eligible children. Although not 
fraud or abuse, these two factors 
served to decrease program fund- 
ing, thereby offsetting the increase 
that resulted from including ineligi- 
ble students. 


Scope and Objectives 


The Migrant Education Program 
(authorized under Title | of Public 
Law 89-10, the Elementary and 
Secondary Education Act of 1965, 
as amended) allocates its funds 
(some $245 million for fiscal year 
1980) to State departments of 
education on the basis of estimates 
of the full-time equivalent (FTE) 
number of eligible migrant children 
residing in the State during the 
calendar year. By enrolling eligible 
children on a centralized computer 
system—called the Migrant Student 
Record Transfer System (MSRTS)— 
a State accrues FTE credit for each 
day, up to 365 days, the child is 
enrolled from that State on the 
system. Typically, enrollments on 
the system coincide with enroll- 


ments in migrant-funded schools. 

As with many Federal programs, 
eligibility criteria for the program 
are complex and difficult to ad- 
minister. Eligibility depends upon 
the occupation and movement pat- 
terns of the child’s parents or guard- 
ians and the movement pattern of 
the child. In addition, eligibility for 
inclusion in the funding counts re- 
quires that the child be between the 
ages of 5 and 17. 

Using calendar year 1977 as the 
base year, two objectives were 
selected for the study of the Migrant 
Education Program funding counts: 
e Objective 1—to assess the ac- 
curacy of the information in the 
MSRTS used for determining the 
1977 FTE counts. 

e Objective 2—to assess the com- 
pleteness of the MSRTS data in 
terms of coverage of the eligible 
migrant population during 1977. 
The focus on both the accuracy and 
completeness of the funding counts 
reflected that a narrower focus on 
the number of ineligibles would not 
have given decisionmakers all the 
information they needed to design 
cost-effective safeguards against 
fraud and abuse and ensure that 
program-funding levels were based 
on good estimates of the target 
population size. Focusing solely on 
the number of ineligibles would 
have left decisionmakers with only 
half the information required to 
estimate the overall accuracy of the 
funding counts. To appreciate the 
problem fully, decisionmakers also 
needed information on the extent of 
the undercount of eligible migrant 
children. 


Methodology 


In brief, each study objective for 
the Migrant Education Program 
evaluation constituted a separate 
substudy. To validate the accuracy 
of the information in the MSRTS, a 


.probability sample was chosen of 


some 9,000 children whose enroll- 
ments on the MSRTS contributed to 
the FTE count for calendar year 
1977. These were the counts on 
which program allocations for fiscal 
year 1979 were based. For each stu- 
dent, the following data were col- 
lected during site visits and through 
mail questionnaires: (1) date of 
birth, (2) evidence of the child’s 
eligibility with respect to movement 
and parental occupation, and (3) 
school enrollment and residence in- 
formation affecting 1977 counts. 
The sample and data collection 
were designed to answer the follow- 
ing questions: 

e How do national and regional 
FTEs based upon school enrollment 
and residence histories developed 
from field data compare to the na- 
tional and regional FTE counts 
based upon 1977 MSRTS data? 

e How accurate and complete was 
the 1977 MSRTS information used 
for funding? 

¢ How many (if any) of the students 
included in the MSRTS counts did 
not meet the eligibility requirements 
for generating funds? 

Because of the enormous cost re- 
quired to estimate the number of 
eligible children not included in the 
1977 FTE counts, less rigorous 
methods were used to meet this ob- 
jective. A probability sample of 
children in some 2,500 classrooms 
was screened to determine their eli- 
gibility for the Migrant Education 
Program. Efforts were then made to 
determine whether eligible children 
were enrolled on the MSRTS and in- 
cluded in the 1977 counts. Esti- 
mates of eligible migrant children 
who were not enrolled in school and 
not included in the 1977 funding 
counts were obtained from ques- 
tionnaire items asking school of- 
ficials to estimate the number of 
such children who resided in their 
county. It was not possible to verify 
whether such children had been in- 
cluded in the FTE counts from some 
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other county. The sample and data 
collection strategy permitted very 
“soft” answers to the following 
questions: 

¢ How complete were 1977 MSRTS 
data in terms of their coverage of 
the population of eligible migrant 
children who were enrolled in 
school? 

¢ How complete were 1977 MSRTS 
data in terms of their coverage of 
the population of eligible migrant 
children who were not enrolled in 
school? 


Summary of Findings 


Data analysis indicated that 
fraudulent inclusion of ineligibles in 
the funding counts for 1977 was 
relatively low. Birth date errors had 
little effect on the 1977 FTE count. 
Inclusion of children outside the 5 
to 17 age range was balanced by 
failure to include those whose birth 
dates fell in the age range. Approx- 
imately 2 percent of the 1977 FTEs 
were generated by children who 
failed to meet the movement and 
parental occupation eligibility re- 
quirements. Another 2 percent of 
the FTEs were accrued by eligible 
migrant children while they were out 
of the country. 

Other findings relevant to the 
funding counts indicated that the 
1977 FTE counts (both for the Na- 
tion as a whole and for the regions 
defined for the study) represented a 
conservative estimate of the total 
number of migrant children. Survey 
data indicated an undercount of 
FTEs accrued by eligible migrant 
children who were enrolled on the 
MSRTS during 1977. The undercount 
of approximately 12 percent held 
fairly uniformly across the 5 geo- 
graphic regions defined for the 
study. The major reason for the 
undercount appeared to be the in- 
completeness of enroliment data. 
For example, a student enrolled in 
September and not re-enrolled the 
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following September would not ac- 
crue FTE credit during the period 
from September through the end of 
December. 

Soft data on the number of eligi- 
ble students who accrued no FTE 
credit in 1977 indicated that some 
15 to 20 percent of the population of 
eligible children who were in school 
in early 1978 were not enrolled on 
the MSRTS in 1977 and therefore did 
not accrue FTE credit. School of- 
ficials estimated that the number of 
out-of-school migrants in 1977 was 
relatively small, and their contribu- 
tion to the undercount was there- 
fore likely to have been minimal. 


Conclusion 


Fraud and abuse reviews can be 
designed to meet any one of a num- 
ber of objectives, depending upon 
the purpose of the review. In cases 


where the fraud and abuse is be- 
lieved to be blatant, it may be ap- 
propriate to conduct an audit of pro- 
gram operations at a judgment sam- 
ple of sites for enforcement and 
deterrence. Where there is some 
question as to the magnitude of the 
fraud or abuse programwide, it may 
be more cost effective to conduct a 
large-scale statistical evaluation to 
determine the degree of fraud and 
abuse before devoiing scarce re- 
sources to audits on a site-by-site 
basis. In return for the time and ex- 
pense of conducting a large-scale 
statistical review, the evaluator is 
able to determine the magnitude of 
the fraud and abuse in the program 
and use that estimate as the basis 
for recommending the appropriate 
type of control mechanisms, be they 
sophisticated monitoring systems 
or less costly training, technical 
assistance, and spot checks. 
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New Directions in the 


Policymaking Process 
of 


in a Decade 
Transition 


This article, adapted from an address 
given by Mr. Hunter at a November 1981 
symposium for the Washington Operation’s 
Research/Management Science Council, 
discusses Mr. Hunter’s views on the new 
directions in the policymaking process. 


Introduction 


New directions in the policy- 
making process will incorporate a 
long-range perspective, rather than 
the current 1- or 2-year approach. 
The new process will require multi- 
disciplined analyses to support 
decisionmaking on major policy 
issues. This article outlines the 
main features of the old process, 
discusses the recent procedures 
used to develop the Reagan Eco- 
nomic Recovery Plan, and predicts 
how some of the elements in this 
process will change during this 
decade. 

Senator Roth’s Committee on 
Governmental Affairs and Represen- 
tative Gills Long’s subcommittee of 
the House Committee on Rules are 
currently investigating the changes 
needed in the congressional budget, 
legislative, and oversight activities. 
In addition to these committees, a 
newly formed private Committee 
For A Responsible Federal Budget 
is also developing recommenda- 
tions for improvements. 


GAO Encourages 
Reform 


GAO’s recommendations for im- 
proving the policymaking process 
are summarized in two reports en- 
titled “Observations on Oversight 
Reform” (PAD-81-117, 1981), and 
“Federal Budget Concepts and Pro- 
cedures Can Be Further Strength- 
ened” (PAD-81-36, March 3, 1981). 
The GAO observes that changes in 
procedures do not guarantee a suc- 
cessful administrative reform. 

GAO’s report, “Observations on 


Oversight Reform,” states on page 1 

that 

Success will depend upon the com- 

mitment of the leaders and partici- 

pants to the goals of the reform. 

New laws can only create mecha- 

nisms and procedures which will 

permit this commitment to be effec- 
tively translated into action. The 

Congress, the Executive, and ulti- 

mately the nation must: 

1) think, debate, and act with a 
long-range perspective because 
the full implication of policies 
often is not felt for several years 
or decades; 
focus more of their analyses, 
debates, and actions on broad 
policies and groups of interre- 
lated programs; 
try harder to analyze the prob- 
able effects of policy. changes 
before they are implemented; 
be more specific and realistic 
when setting goals and expecta- 
tions for policies, programs, 
and administrative reforms; 


grant administrators the author- 
ity and resources needed to 
render congressional goals and 
expectations plausible, or to 
to revise them to fit available 
resources; 
establish evaluating and report- 
ing procedures that compel ad- 
ministrators to produce clear 
Statements about the perfor- 
mance of the programs and 
activities for which they are 
accountable; 
structure iterative management 
processes to ensure that deci- 
sionmakers will consider eval- 
uation results in their planning 
and direction of programs; and 
8) act promptly to make changes 
when needed. 


To promote these objectives, GAO 
has strongly supported oversight 
reform and suggested that another 
Hoover-type commission be estab- 
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lished. GAO has also supported fur- 
ther changes in the budget process 
and suggested that another com- 
mission on budget concepts be 
created. 


The Old Federal 
Process 


The old Federal process operated 
during the annual budget cycle and 
the 2-year congressional cycle. Gen- 
eral ‘‘top down” guidance was given 
to each agency, which formulated 
its own budgetary proposals with a 
“bottom up” effect. There was a 
considerable amount of control over 
elements in programs. With legisla- 
tive vetos, limitations on appropria- 
tions, and clearance requirements 
by the executive branch, each pro- 
gram was examined carefully. For- 
mal accountability was principally 
financial accountability. However, 
there was a basic weakness in this 
approach. Evaluation and multidis- 
ciplined analyses were talked 
about, but they were not part of the 
basic policymaking process. In the 
upcoming decade, complicated 
social issues will require new multi- 
disciplined analyses to improve 
policymaking. 


Direction of Changes in 
Policymaking 


Some scholars describe the 1980’s 
as a decade of transition. The tran- 
sition will involve social values, the 
roles and relationships of domestic 
and international institutions, the 
technologies that support our econ- 
omy, and the goods and services 
available to us. | share their view. 

To deal effectively with the policy 
issues of the 1980’s transitional 
decade, we need more innovative, 
multidisciplined analyses and 
evaluations to support decision- 
making. For example, the issues 
created by aging and the “baby 


GAO Review/Spring 1982 


New Directions in the Policymaking Process in a Decade of Transition 


boom’”’ on the society and economy 
should not be addressed from one 
or even a few perspectives. The 
“baby boom” group has moved 
through our schools, and now we 
have excess schools and teachers. 
As this group ages, it will put extra 
demands on many of our institu- 
tions, including prisons, housing, 
and eventually health care and pen- 
sion systems. 

Many issues, like the example 
above, can also cause the same 
kind of demands on our society. 
Some of these issues are 
® economic and military vulner- 
ability, 

e later retirement, 

e family choice regarding work, re- 
sponsibilities, and life styles, 

® new communications and com- 
puter services, 

e rediscovered concern for quality, 
and 

¢ biogenetics. 

These issues have been emerging 
for many years. Our society is chang- 
ing, and these issues are appearing 
on public policy agendas frequently. 
Individuals are changing our society 
by making decisions on these issues 
every day. Americans are choosing 
to retire later. Computers have 
become a household word and de- 
vice. There are many examples of 
how our society is changing. These 
changes will soon have to be 
acknowledged by our decision- 
makers, and eventually the deci- 
sionmakers will have to deal with 
these changes in public policy. 
When decisionmakers deal with 
these issues, they will have to con- 
sider the multiple facets of each 
complicated issue. To consider 
each facet properly, decisionmakers 
need to use multidisciplined analy- 
ses and evaluations. 


Current Developments 


Today, the politicians are concen- 


trating on economic recovery and 
military vulnerability in their deci- 
sionmaking. These are critically im- 
portant issues for our Nation at this 
time. The Reagan Administration’s 
approach resembles the strategic 
planning approach used in private 
industry. However, the Administra- 
tion must use the old Federal proc- 
ess to implement their new plan. 
The Administration developed a set 
of quantitative goals that they are 
seeking to achieve. Much of the 
debate over policy is now focusing 
on attaining these goals, as well as 
the means being advocated by the 
Reagan Administration to achieve 
them. 


The intentions of the Reagan Ad- 
ministration are to 


e strengthen defense; 
© preserve the social safety net; 
e revise entitlements to eliminate 
unintended benefits; 
e reduce subsidies to middle- and 
upper-income groups; 
e impose fiscal restraints on other 
national interest programs; 
e recover costs that can be clearly 
allocated to users; 
e stretch out and retarget public 
sector capital investment programs; 
e reduce overhead and personnel 
costs of the Federal Government; 
® apply sound economic criteria to 
subsidy programs; and 
e consolidate categorical grant pro- 
grams into block grants. 

Essentially, the Administration’s ap- 
proach includes 
e 4-year goals used rather than the 
old 1- or 2-year goals; 
e clear policy choices based on ex- 
plicit Administration criteria; 
© control focused on aggregate bud- 
get and economic figures instead of 
the individual elements of programs; 
and 
® accountability focused on imple- 
menting the Administration’s policies. 





New Directions in the Policymaking Process in a Decade of Transition 


Forecast for the Future 


Considering what we know about 
the old Federal process and what 
we have learned from our recent ex- 
periences, | predict the following six 
changes will occur. 

First, the process will likely shift 
to using multiple-year periods. This 
could include a change to a biennial 
fiscal period, with 4 to 8 years 
covered by many of the supporting 
analyses and planning. 

Second, the Federal Government 
will increasingly use centralized, 
Strategic-type policymaking and 
direction to address the major 
policy issues. But this change could 
be accompanied by an increase in 
flexibility to program managers 
regarding operations. 

Third, where tough decisions are 
needed, we may see clear policy 
choices on issues, such as social 
security and major capital invest- 
ments. But incremental change is 
likely to continue to be the norm for 
most policy areas. 

Fourth, the Congress and the ex- 
ecutive branch are likely to retain 
tight controls over the aggregate 


budget levels, individual programs, 
and program elements. In a pro- 
tracted period of social and eco- 
nomic change, uncertainty, shifting 
responsibilities, and constrained 
resources, no one in the policymak- 
ing process is likely to give up any 
degree of control, and most people 
will be seeking more control. 

Fifth, formal accountability is 
likely to be extended beyond exist- 
ing financial accountability to 
include some regular analysis and 
explanation of variances from the fi- 
nancial and operating plans. Pro- 
gram evaluation, performance moni- 
toring, auditing, inspection, etc., 
may all be used to help identify the 
causes of variations, but there is not 
likely to be any demand or need fora 
large, centralized system approach. 

Sixth, leadership styles and 
methods may also undergo some 
change. Daniel Yankelovich says 
that the mix of social values emerg- 
ing in the next decade will include a 
rediscovery of concern for the 
future, a strong interest in having 
choices, increased concern for 
whole institutions, and increased 
cooperation among institutions. | 
believe that leadership styles and 


methods are also likely to shift 
toward these social values and 
therefore become more proactive. 
How and when such changes may 
occur are among the most specula- 
tive—and most important—aspects 
of the new directions in policymaking. 
Policies, such as the cap on execu- 
tive salaries, add to the uncertainty 
about the quality of government 
leadership during this important 
decade. 


Conclusion 


Social values and the nature of 
Our economy are changing. Also, 
the public policy issues are becom- 
ing more interrelated and complex 
to address. Public policy institu- 
tions and the policymaking process 
need to be strengthened to ensure 
they have the capacity to provide ef- 
fective leadership. | have described 
several changes in policymaking 
that | believe will strengthen its 
capacity in the next decade. GAO 
has strongly supported the Con- 
gress in identifying problems and 
searching for improvements. 
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PREFACE 


It is axiomatic in today’s world 
that when seemingly limitless funds 
are made available to a Federal 
agency, cost saving opportunities 
frequently become lost in the frantic 
rush to spend and spend so that all 
concerned will view the funds as 
needed and justified. Unfortunately, 
in this climate, unless areas of 
potential cost savings are identified 
and widely publicized, they do not 
receive the high-level attention that 
is necessary to ensure exploring the 
possibility of reduced expenditures. 

This article points out one such 
area of potential cost savings in the 
Department of Defense that the 
author feels warrants high-level at- 
tention. While the article has been 
written as a fictional dialogue be- 
tween two persons, the information 
presented is factual. It reflects both 
the author’s close association with 
the events described and his own 
provocative views as to what can 
and should be done. 


It’s early December. At the Penta- 
gon, during the Joint OSD-OMB 
review of the military service budget 
estimates, an OMB analyst has re- 
quested a briefing on the Depart- 
ment of Defense Military Payroll 
Systems. The request stems from 
growing OMB and congressional 
concern about recent GAO reports 
on problems in many of these sys- 
tems. In one report, GAO stated, 
“During the past 12 years, the Navy 
has spent over $150 million to devel- 
op and operate a central automated 
military pay system for its military 
personnel. But the centralized sys- 
tem is so unreliable that, as a check, 
local disbursing officers calculate 
pay amounts manually. Each pay- 
day, over 50 percent of the centrally 
computed pay amounts are changed 
to agree with amounts computed 
locally.’ 


Another GAO report stated, “The 
Marine Corps Joint Uniform Military 
Pay System/Manpower Management 
System was authorized in 1966 and 
implemented in 1973. Although 
millions of dollars have been spent 
on the system, as a central system 
to compute Marine Corps members’ 
pay accurately and on time, it is still 
unreliable and inefficient. The 
Marine Corps plans to spend addi- 
tional millions of dollars to replace 
the current system with a more 
sophisticated one in the 1985-90 
time frame. But unless the current 
system is improved and Department 
of Defense monitoring of the Marine 
Corps system development is im- 
proved, many deficiencies in the 
current system will be carried over 
to the new one.” 

And in still another report, GAO 
reported that the Department of the 
Army’s Joint Uniform Military Pay 
System—Reserve Components, used 
to pay Army Reserve and National 
Guard personnel, did not have ade- 
quate controls. As a result, millions 
of dollars in erroneous payments 
were being made? 

In view of the all-out efforts being 
made by the Administration and the 
Congress to rectify a deteriorated 
military manpower base, deficien- 
cies in the payroll systems are coun- 
terproductive because they affect 
the morale and welfare of all mili- 
tary personnel and their families. 
DOD’s plans to eliminate these defi- 
ciencies will be closely scrutinized 
during the OMB and congressional 
budget review process. 

The briefing is arranged. A senior 
Defense official representing the Of- 
fice of the Deputy Assistant Secre- 
tary (Management Systems), part of 
the Office of the Assistant Secre- 
tary of Defense (Comptroller), meets 
with the OMB analyst. The following 
dialogue takes place: 


DOD: Good morning. The purpose of 
this briefing is to provide you with 
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information on Department of De- 
fense Military Payroll Systems. As 
you know, military pay is big busi- 
ness in the Department of Defense. 
Approximately $50 billion of our fis- 
cal year 1981 budget* went to pay 
our military personnel. Every year 
we spend well over $100 million on 
the operation and maintenance of 
our computerized military pay sys- 
tems while additional millions are 
spent on redesigning one or more of 
the 18 different systems used to pay 
our military personnel. The first 
slide lists these systems by service. 
(Slide 1 shown) 

As you can see, the 18 systems 
are used to pay active duty, reserve 
component, retired, and military 
academy cadet personnel.5 


OMB: Why do the Air Force and 
Navy list ROTC Cadet Pay Systems 
in their inventories while the Army 
and Marines do not? 


DOD: Frankly, | didn’t catch that. It 
is possible our inventory is incom- 
plete. | believe the Marines do have 
one ROTC pay system, and | seem 
to recall the Army pays its ROTC 
cadets out of four finance offices on 
a regional basis. To the best of my 
knowledge, these are individually 
designed and operated systems. | 
guess we should add at least five 
more systems to the inventory, mak- 
ing it a total of 23 systems. I’ll con- 
firm the actual number of Marine 
and Army ROTC cadet pay systems. 


OMB: You know, I’ve never really 
understood why it takes 18 or 23 sys- 
tems to pay military personnel. 
Aren’t all military pay policies and 
entitlements established by law, 
and don’t they apply across the 


board to all military personnel, 
regardless of branch of service? 
Doesn’t the DOD Military Pay and 
Allowances Entitlement Manual® 
provide the statutory provisions for 
entitlements, deductions, and col- 
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lections, and establish Department 
of Defense policy on the pay and 
allowances of all military person- 
nel? Don’t these provisions apply to 
all Department of Defense activi- 
ties? Isn’t it the responsibility of the 
DOD Military Pay and Allowance 
Committee and the DOD Committee 
on Military Pay Procedures to 
assure uniformity of the services’ 
pay regulations? If what I’ve asked 
is true, it would seem that all of 
these systems are logical candi- 
dates for single system standardiza- 
tion. Why, for instance, does each 
service have to have its own individ- 
ual pay system to pay its active 
forces if the policies and entitle- 
ments for all services are basically 
the same? Why can’t there be one 
DOD system for the payment of all 
active forces personnel? 


DOD: Your point is well taken, and, 
in fact, the Department has made ef- 
forts in the past to do just as you 
have suggested. | think if we return 
to the briefing now, | can trace these 
efforts, and their results, for you. 
We'll begin with the Department’s 
effort to standardize the systems for 
our active forces. 

In the late 1950’s and early 1960’s, 


the Department of Defense encoun- 
tered serious problems in managing 
its military personnel appropria- 
tions. Appropriation deficits requir- 
ing supplemental funding by the 
Congress in one year would be fol- 
lowed by surpluses in the succeed- 
ing year. In response to repeated 
presidential and congressional criti- 
cisms, the Department conducted a 
study in 1961 to determine the 
cause(s) of the problem. The study’s 
result was DOD Directive 7040.3, 
“Program for Improved Manage- 
ment of Military Personnel Ap- 
propriations and Related Personnel 
Programs of the Active Forces,” 
published on October 2, 1962. A ma- 
jor system change prescribed by the 
directive required that obligations 
for the military pay and allowance 
segment of the military personnel 
appropriation, which comprise 
roughly 86 percent of the appropria- 
tion total, be accounted for monthly 
on the basis of earned (accrued) 
entitlements recorded in individual 
pay accounts and that obligations 
and disbursements be reported in 
classifications designed to assist in 
appropriation management. At this 
time, while each military service 
operated essentially manual, fully 
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decentralized military pay systems, 
appropriation control was exercised 
at the service’s departmental level. 
Thus, it would have taken several 
months for actual monthly obliga- 
tion data to reach the level at which 
appropriation control was main- 
tained. To meet the accrual ac- 
counting and revised reporting 
requirements, each military service 
began developing mechanized 
(PCM) military pay and reporting 
systems. In general, these develop- 
ments were limited to mechanizing 
the recordkeeping and reporting 
within the existing decentralized 
pay systems. 

Concerned with this approach 
and the continuing problems en- 
countered in managing the military 
personnel appropriations for active 
forces, the Comptroller General of 
the United States, in a letter sent to 
the Secretary of Defense on May 14, 
1963, stated in part that: 


In previous reports to the Con- 
gress and to the Department of 
Defense, this Office has pointed out 
weaknesses, inefficiencies, and 
lack of uniformity in the services’ 
administration of many aspects of 
military pay and allowances. The 
basic legislation governing pay and 
allowances of military personnel ap- 
plies, with a few exceptions, uni- 
formly to members of all services. 
The establishment of a uniform mili- 
tary pay system, in our opinion, 
could be expected to simplify and 
improve materially the administra- 
tion of military pay and allowances 
in many ways, including elimination 
of the multiplicity of individual serv- 
ice regulations.’ 


OMB: Yes, | remember that letter. It 
seemed to make a lot of sense at the 
time. 


DOD: Well, that letter, plus added 


pressure to improve management of 
the DOD military personnel appro- 
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priations from what was then the 
Bureau of the Budget, resulted in 
DOD’s establishing a study group in 
July 1963. Its stated objective was 


...[t]o consider appropriate DOD 
systems and procedures for the ac- 
crual of military pay entitlements 
and the payment of military person- 
nel in active service so as to carry 
out the objectives, policies and prin- 
ciples set forth in DOD Directive 
7040.3 with the maximum practic- 
able uniformity in the pertinent 
documentation, processing, record- 
keeping and reporting procedures. 


The group reviewed the administra- 
tive practices, environmental limita- 
tions, problems being encountered 
in the decentralized pay systems of 
each military service, and the plans 
being considered for mechanizing 
the pay systems. Based on its find- 
ings, the group considered recom- 
mending the development of a 
single, standard DOD military pay 
system. Strong objections from the 
services, as well as the finding of 
approximately 200 pay and pro- 
cedural differences between the ser- 
vices (35 of which were statutory), 
forced the group to seek a solution 
that would be acceptable to all par- 
ties and stiil meet the spirit of the 
objectives. The group completed its 
study in January 1966 and recom- 
mended to the Secretary of Defense 
that each service be required to 
develop a centralized pay system 
using a computer at a single site. 


OMB: What were the services’ objec- 
tions to having a single standard 
DOD pay system? Were they ever 
fully evaluated? 


DOD: |’m sorry, | don’t have that in- 
formation. To continue, as a result of 
the study group’s recommendation, 
DOD Directive 7330.3, “Program for 
Development, Test, Evaluation and 
Installation of the Joint Uniform 


Military Pay System,” was issued in 
November 1966, directing the mili- 
tary services to develop comparable 
military pay systems. The systems 
were to be known as the Joint Uni- 
form Military Pay System (JUMPS). 

The DOD directive established 
four primary objectives for the new 
pay system: (1) adequate pay serv- 
ice to the military member, (2) uni- 
formity among the services to the 
extent possible, (3) one master 
military pay account for each active 
duty member on a computer at a 
single operating site, and (4) produc- 
tion of comprehensive, accurate, and 
timely accounting reports for the 
military personnel appropriation 
director. 

By placing all pay accounts ona 
computer and eliminating most 
manual computations of pay, DOD 
hoped to reduce overpayments sub- 
stantially, and by centralizing the 
accounting and reporting function 
at a single site, DOD believed more 
timely and accurate data and a sub- 
stantially increased budgeting 
capability would result, thus resolv- 
ing the two primary problem areas 
causing appropriation deficits. 


OMB: You know, what you just said 
would apply equally to a single, 
standard DOD system. 


DOD: That’s true, but the decision 
was to go with individual service 
systems having these capabilities. 


OMB: You say the directive to 
develop these systems was issued 
in 1966. When were they actually 
completed? 


DOD: While not prescribed in the 
directive, based on the study team 
recommendations, the services 
were given targets of completing 
operational tests of their systems 
by June 30, 1968, with full imple- 
mentation of JUMPS by June 30, 
1969. 
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Unfortunately, for a variety of rea- 
sons, these targets were never met. 
Army was the first to field their ver- 
sion of JUMPS, beginning their 
worldwide conversion in June 1971 
and completing it in December 1971, 
when all soldiers, including those 
serving in combat in Vietnam, were 
paid from the Army Finance Center 
at Fort Benjamin Harrison, Indiana. 
It was not until August 1973 that the 
Marine Corps began to field their 
version of JUMPS. This is one of the 
systems that has encountered 
severe problems since its imple- 
mentation, and the Corps is plan- 
ning to replace this version with a 
more sophisticated one in the 
1985-90 timeframe. Finally, in 
November 1974, the Air Force field- 
ed its JUMPS, and in January 1977, 
the Navy completed its system. As 
you are aware, this is another 
system that has been in trouble 
since its implementation and will re- 
quire a major redesign effort. 

This concludes the portion of the 
briefing on the status of active 
forces military pay systems. 

Before moving on to the status of 
our Reserve Component, Retired, 
and Military Cadet pay systems, do 
you have any questions on what we 
have just covered? 


OMB: Yes, | do. | still have a problem 
understanding why each service 
must operate and maintain its own 
system to pay its military personnel 
if the only significant difference in 
the functional requirements of the 
system is the difference in some 
pay entitlements. It would seem a 
single computer table could accom- 
modate these differences. And if 
this is true, | can’t understand why 
these systems cannot be standard- 
ized into a single DOD system. It 
would seem that the savings, in 
terms of personnel and those costs 
associated with operating, main- 
taining, and redesigning all these 
current systems, would be substan- 
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tial, not to mention the potential for 
improving servicemen’s morale by 
eliminating some of the problem 
systems. Does DOD have any plans 
to go with a single DOD-wide sys- 
tem in the future? 


DOD: | am not aware of any plans to 
do this at the present time. 


OMB: Well, since DOD has allowed 
each service to develop its own ver- 
sion of JUMPS, in the event, say, 
that the Army Finance Center goes 
out of business due to a disaster, 
can one of the other services pick 
up and pay the Army people? Can 
any of the services provide backup 
for one another? 


DOD: The answer to your question is 
no. The systems, procedures, rec- 
ords, reports, forms, and even the 
computer hardware and/or hardware 
configurations are so different that 
no capability exists to provide 
cross-service support in case of an 
emergency. 


OMB: Then since the other services 
could not pay the Army people if the 
system at the Finance Center went 
down, | presume the Army has plans 
to meet this contingency? 


DOD: Depending on the severity of 
the situation—. 


OMB: Let’s take a worst case sce- 
nario: the Army Finance Center 
burns down. 


DOD: In that case, Army would be in 
serious trouble. Because of funding 
limitations, back-up computers at 
alternate sites do not exist. Alter- 
nate files are maintained, but these 
are only good if you have sym- 
pathetic computers. Currently, 
these do not exist outside of the Ar- 
my Finance Center. In short, Army 
would be forced to pay its soldiers 
by manually computed local pay- 


ments at field sites throughout the 
world for an extended period of time 
until new facilities and hardware 
became available. There would be 
serious problems in not only paying 
soldiers what they are due, but also 
in paying their allotments to 
families, banks, and so on. 


OMB: | find that rather frightening. 
The impact on soldier morale would 
be devastating, especially if this 
were to occur in a wartime situation. 
| suppose this is the price to be paid 
by putting all your eggs in one basket 
and then providing no back-up capa- 
bility. 


DOD: It’s a calculated risk, but in 
over 10 years of operation, the 
Army’s system has never missed a 
payday. Are there any other ques- 
tions? 


OMB: Just one more. What if it were 
necessary to mobilize our reserves? 
Could these systems handle sub- 
stantial increases in the number of 
records to be maintained and peo- 
ple to be paid? 


DOD: I’m sorry, | don’t have the 
answer to that question. I’m not 
sure if the present hardware and 
telecommunications used by the 
services’ systems could handle a 
sudden and substantial increase. 


OMB: Well, then, will these systems 
work if we were to go to war? It 
seems to me this is a vital factor. 
And if they won’t work, just what are 
the Defense plans for paying our 
servicemen and their families? 


DOD: The only system which has 
been tested and proved in a semiwar 
environment is the Army’s. As | indi- 
cated earlier, it was actually used to 
pay soldiers in Vietnam beginning in 
1971. | can’t tell you if the other serv- 
ices’ systems will work, but they 
are supposed to have that capability. 
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OMB: Yes, but it would seem that if 
they are having trouble making pay- 
ments in peacetime, with its fairly 
stable operating environment, as 
GAO found, they certainly would 
have much more trouble in wartime. 
So, | repeat, what are the Defense 
plans for paying servicemen if these 
systems do not work? 


DOD: The only answer | can give you 
is that each service is responsible 
for having contingency plans to 
meet this situation. 


OMB: Do they? 


DOD: | can’t answer that question, 
but | will get the information for you. 


OMB: Thank you. | guess my confu- 
sion comes from your calling these 
systems Joint Uniform Military Pay 
Systems. From what you’ve told me, 
the only thing joint or uniform about 
them is that they each must use a 
computer at a single operating site. 
Insofar as uniformity among the serv- 
ices in procedures and other system 
requirements, it does not exist. Can 
we move on now to the other cate- 
gories of military pay systems? 


DOD: In a December 14, 1973, memo- 
randum, the Assistant Secretary of 
Defense tasked the Assistant Secre- 
tary of Defense (Comptroller) to ini- 
tiate a program for management 
systems standardization within the 
Department. A ‘Management Sys- 
tems Standardization Steering Com- 
mittee,” comprised of DOD and 
military service representatives, 
was established to review then- 
current systems and recommend 
candidate systems for standardiza- 
tion. Among those reviewed were 
the Reserve Component, Retired 
Pay, and Military Academy Cadet 
pay systems. Based on the objec- 
tions of the services, consideration 
of those systems as candidates was 
deferred and subsequently dropped. 
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Some of the objections raised were 
valid. For instance, the Army cited 
its plans to link its Reserve Com- 
ponent and Retired Pay systems 
with its version of the Joint Uniform 
Military Pay System for active 
forces. By this linkage, in one sys- 
tem the Army would be able to com- 
pute and make payments to its sol- 
diers from the time of their entry into 
service until their departure or 
death. By linking Reserve Compo- 
nents pay to JUMPS, the ability to 
transfer a soldier from one status to 
another (reserve to active forces) in 
the event of mobilization would be 
significantly enhanced. The Army 
plans did not include linkage of 
cadet pay with JUMPS; however, 
three of the four systems would be 
consolidated into a single system. 


OMB: That’s very interesting and 
certainly makes a lot of sense. Did 
the Army, or any of the other serv- 
ices, ever follow through with these 
plans? 


DOD: No. Each service continues to 
operate separate systems with no 


-linkage between them. In the Army’s 


case, | believe the problem was a 
lack of computer capacity. 


OMB: So, as with the active forces 
systems, there is no DOD-wide stan- 
dardization of these systems, either. 
Out of curiosity, do you know which, 
if any, systems the task force did 
recommend for standardization? 


DOD: | believe there were two or 
three. | do know the Civilian Person- 
nel systems within Defense were 
recommended for standardization. 
lf there are no other questions, 
this concludes my presentation. 


OMB: Thank you, it’s been most in- 
formative. Let me see if | can sum- 
marize what | think I’ve heard. 
First, in point of fact, there is no 
uniformity or standardization of 


military payroll systems today within 
the Department of Defense. From 
what you’ve told me, this goes back 
to the 1966 DOD policy decision that 
allowed the services to develop their 
own versions of JUMPS for paying 
their active forces. In retrospect, 
this decision could be characterized 
as illogical and shortsighted 
because the original goal of achiev- 
ing a single standard DOD military 
pay system for all the services was, 
and always has been, attainable. 
The rationale concerning pay enti- 
tlement differences was neither 
then, nor is now, a valid justification 
for allowing the services to go their 
own ways. The decision was prob- 
ably more a reflection of DOD’s in- 
ability to control the services’ 
rivalries. 

Since the time of that decision, 
hundreds of millions of dollars have 
been spent on designing, operating, 
maintaining, and redesigning some 
23 different service systems, each 
operating at varying degrees of effi- 
ciency and effectiveness. While 
there are four basic categories of 
systems within the services—active, 
reserve, retired, and cadet—which 
provide for logical systems _link- 
ages, none currently have this capa- 
bility, and all 23 systems operate in- 
dependently. Because of the lack of 
uniformity between the services in 
the systems, procedures, records, 
reports, forms, and even the com- 
puter hardware and/or configura- 
tions of hardware, no one service 
can be called upon to backup 
another in the event of a system 
failure by one or more of the serv- 
ices. Whether these systems would 
even work in wartime is subject to 
question. 

Based upon current DOD plans, it 
would appear no change is to be 
made to the basic 1966 policy. Each 
of the services will be allowed to re- 
design their current JUMPS, and 
from what you've said, such efforts 
are already underway. As a result, 
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duplications in the Reserve Compo- 
nent, Retired, and Military Cadet 
pay systems will be allowed to con- 
tinue. 

Personally, | believe you are going 
to have a hard time defending this 
policy. | am going to recommend 
this matter be raised before the joint 
review committee, and | will further 
recommend that funding requests 
for the JUMPS and other redesigns 
of military pay systems be dropped 
from service budget estimates, 
pending a full reevaluation of DOD 
systems standardization policies. 


Frankly, this has been so helpful, 
| would appreciate a similar briefing 
on the status of standardizing the 
DOD civilian payroll systems you 
mentioned earlier. 


DOD: Okay, I'll get you the date, 
time, and room number in a day or 
two. 


xk 


While the OMB analyst’s ‘“recom- 
mendations” in the fictional dia- 


logue would appear to be logical 


and justified, based on the facts pre- 
sented, the question remains: Will 
they ever be made in the context of 
today’s funding of the Department 
of Defense? Will the frantic rush to 
spend result in more funds being 
poured into the quicksand of individ- 
ual service systems, to the detri- 
ment of a single, uniform DOD mili- 
tary pay system that is effective, 
efficient, and far less costly? Only 
time will tell, but the odds are that 
savings will once again be sacrificed 
on the altar of spending. 
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The Revised Government 
Audit Standards 


This article, slightly adapted, appeared in 
the Fall 1981 issue of the Government Ac- 
countants Journal. 


A milestone in the field of Govern- 
ment auditing was reached in 1972, 
when the Comptroller General of the 
United States issued the Standards 
for Audit of Governmental Organiza- 
tions, Programs, Activities, and 
Functions. The standards were the 
result of a series of discussions be- 
tween GAO staff, the Comptroller 
General, and representatives of 
State audit organizations. The 
publishing followed about 212 years 
of effort on the part of a work group 
that included primarily Federal 
audit specialists, but it was 
assisted materially by a team of 
consultants from State and local 
governments, from academia, and 
from public accounting. 

The standards, during the period 
1972 to the present time, have been 
accepted by audit organizations of 
State and local governments and by 
the public accounting profession. 
Many States incorporated the stan- 
dard into their internal audit opera- 
tions, following suit of the Federal 
Office of Management and Budget 
that required their use by Federal 
agency internal auditors. 

The standards brought to the field 
of government auditing an expanded 
scope: the addition of reviews into 
areas of management and perfor- 
mance. The standards crystallized 
progressive methodologies used 
by some of the more advanced au- 
dit staffs, and they promoted new 
audit techniques that showed prom- 
ise toward achieving better audit 
operations. 


The Revised Standards 


During the late spring of 1981, 
GAO released a second revision of 
the original audit standards issued 
in June 1972. The first revision, in 
1974, contained two small but im- 
portant language changes. The 1981 
revision was more substantial. From 
1970 to 1972, the original standards 
went through eleven drafts, includ- 
ing two exposure drafts, and the 


standards, when they were pub- 
lished, were substantially like the 
second exposure draft. The 1981 
standards were released for expo- 
sure only once, and the final release 
was considerably different from the 
exposure draft in arrangement and 
implied philosophy. 

The 1972 standards were general 
in nature and applied equally to the 
three segments of auditing con- 
sidered in the “‘full-scope” concept: 
(1) audits of financial and com- 
pliance aspects, (2) audits of effi- 
ciency and economy aspects, and 
(3) audits of program review (effec- 
tiveness) aspects. The present body 
of standards, with the exception of 
four general standards, are divided 
into two parts: (1) applications to 
financial and compliance auditing 
and (2) applications to economy, 
efficiency, and effectiveness (pro- 
gram review) auditing. This arrange- 
ment is a material change from the 
arrangement in the 1972 standards 
(as well as the arrangement in the 
one exposure draft of this 1981 revi- 
sion of the standards). 

There is another rather substan- 
tial change in the Examination and 
Evaluation and Reporting section 
applying to Financial and Compli- 
ance Audits (Section C). This change 
is the predominance of the AICPA 
Statements on Auditing Standards. 
There is, however, some augmenta- 
tion of this body of CPA standards. 
This augmentation consists of four 
subordinate GAO standards that are 
described as being added to “satisfy 
the unique needs of government.” 

The 1981 revision contains many 
needed changes, augmentations, 
and new ideas. The work done by 
GAO in revising the standards 
should be appreciated as adding to 
the audit progress started when the 
original standards were issued in 
1972. 


Steps Leading to the 
Revision 


When the original government 
audit standards were being devel- 
oped during 1970 to 1972, the work 
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group that was developing them be- 
lieved that a series of implementing 
activities would assist to keep the 
standards current and up-to-date. 
Several of these planned activities 
were 

e presenting a series of orientation 
seminars throughout the Nation for 
Federal personnel, State and local 
government personnel, and public 
accountants; 

e developing a procedure for pub- 
lishing implementations, interpreta- 
tions, and explanations; 

e publishing a series of audit stan- 
dard supplements; and 

e establishing a plan for periodic 
conferences to discuss the stan- 
dards and to recommend improve- 
ments. 


All of the above activities did take 
place. It is believed that they helped 
increase use of the standards during 
the past 9 years. The last activity, 
the periodic conferences, was merged 
with the Intergovernmental Audit 
Forums, developed and supported by 
the Comptroller General through the 
General Accounting Office early in 
1973. These forums, the National 
Forum and the 10 Regional Forums 
had as some of their objectives the 
implementation, interpretation, and 
improvement of the audit standards. 
The forums have developed innova- 
tive implementation of the stan- 
dards, such as methodologies for 
the conduct of efficiency and econ- 
omy audits, of program results 
audits, and of fraud and abuse 
audits. Also, the forums have made 
periodic suggestions for changes to 
the standards. 

The American Institute of CPAs 
has also suggested, both formally 
and informally, changes in the stan- 
dards. The 1974 modification came 
from this source. The various asso- 
ciations of State and local auditors 
have also been active in suggesting 
changes for the standards. Finally, 
in 1979, the Comptroller General 
determined that the standards 
should be revised. 

Under the direction of the late 
GAO chief accountant, Donald L. 
Scantlebury, and group leader 
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William A. Broadus, a project was 
developed that incorporated most of 
the suggested changes from the 
last few years. An exposure draft 
was released late in 1980, and a 
large number of comments were 
received. Many called for making 
the standards for financial and com- 
pliance auditing more realistic and 
practical, relating them directly to 
the AICPA audit standards, and 
divorcing this type of auditing from 
the management (economy and effi- 
ciency) and program results audit- 
ing. The standards were revised, to 
the degree possible, to incorporate 
most of the suggestions. 

The standards were signed by 
Elmer Staats, the Comptroller Gen- 
eral, during the last week before his 
retirement on March 3, 1981. The 
standards are indeed a monument 
to his foresightedness and recogni- 
tion that a body of standards was 
the necessary ingredient for improved 
auditing and through improved 
auditing, hopefully, for improved 
governmental management. 


The Intent of the New 
Standard 


In an article for American Account- 
ing Association’s Public Sector Sec- 
tions Newsletter, Mr. Broadus stated 
that the standards had been revised 
to 
* expand the explanations of some 
standards in response to questions 
about them; 
¢ separate the standards for finan- 
cial and compliance audits from 
those for economy and efficiency 
audits and program results audits; 
¢ incorporate standards relating to 
audits in which automatic data 
processing systems are used by the 
entity; 

e add a standard to make more 
specific the auditor’s responsibility 
for detecting fraud, abuse, and il- 
legal acts in government programs 
and operations; 

e clearly incorporate the AICPA’s 
Statements on Auditing Standards 
for field work and reporting into the 
examination and evaluation and 


reporting standards for government 
financial and compliance audits; 

e add additional standards and re- 
quirements for government finan- 
cial and compliance audits; 

e clarify the meaning of compliance 
auditing and clarify when expanded 
scope auditing should be _ per- 
formed; and 

e discuss the handling of future of 
AICPA pronouncements and the is- 
suance of future pronouncements 
by GAO. 

Following is brief descriptive 
material dealing with each of the 
standards so as to provide an over- 
view of the entire body of revised 
government audit standards. 


The Expansion of 
Scope 


The first standard, relating to the 
scope of the audit, is probably one 
of the most important of all the stan- 
dards. It is because of this impor- 
tance that the standard was given 
the status of a separate classifica- 
tion. The standard establishes the 
parameters of the audit. It provides 
that audits will be expanded beyond 
pure fiscal aspects into broader 
areas of management. However, 
along with the fiscal or financial ele- 
ment of the audit, there is included 
an examination to determine com- 
pliance with laws and regulations 
because noncompliance can, in 
many cases, have a financial impact 
on the organization. This compli- 
ance, in the revision, is described as 
being of more consequence in that 
it also applies to efficiency and 
economy audits as well as program 
results (or effectiveness) audits. 
These noncompliant activities may 
also have financial aspects on the 
auditee organization. 

The review of efficiency and econ- 
omy should determine whether the 
organization and its officials are 
carrying out their responsibilities 
while at the same time conserving 
resources and providing for a mini- 
mum expenditure of effort. 

Where there are uneconomical or 
inefficient practices disclosed, the 
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auditor should determine whether 
they were caused by the absence of 
or invalidity of performance stan- 
dards or by not using control sys- 
tems to maintain efficient and eco- 
nomical operations. The auditor 
should report findings and conclu- 
sions and should recommend im- 
provements where appropriate. 

The expansion of scope into effec- 
tiveness areas is intended to deter- 
mine if the organization is achieving 
its objectives and goals. 

In the end, the auditor must realize 
that all audits will not require this en- 
tire expanded spectrum of audit ac- 
tivity. The audit should be broad 
enough to meet the needs of all 
potential users of the audit reports. 
The point to be considered is that the 
benefits to be achieved must com- 
pare favorably with the potential cost 
of the audit effort. 


The General 


Standards 


The four general standards in this 
classification are (1) qualifications of 
Staff, (2) independence of the staff 
members and of the organization, (3) 
due professional care, (4) and scope 
impairments. Descriptions of the 
four standards follow: 

The Qualifications of the Staff— 
With the expansion of the scope of 
the audit into areas of management 
and operations, skills that heretofore 
were unnecessary are now required. 
However, because all of these skills 
are infrequently found as attributes 
of a single auditor, it is necessary to 
plan to have the skills available as a 
part of a pool of diversely talented 
specialists or through the use of con- 
sultants for such areas as statistics, 
law, engineering, and actuarial 
science. 

The skills must include, in addi- 
tion to basic accounting and audit- 
ing, a good knowledge of the laws, 
regulations, policies, procedures, 
and directives within which the 
government organization operates 
and with which it must comply. Per- 
sonnel must also be available who 
have a knowledge of management 
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functions, such as planning, organi- 
zation, staffing, directing, and con- 
trolling; also a knowledge of com- 
munications, computer operations, 
management information systems, 
and decision analysis. Finally, the 
auditor should be able to evaluate 
the control processes that the orga- 
nization should be using to monitor 
its own effectiveness. 

Technical competence should be 
maintained through continuing 
education. 

Independence of the Organization 
and the Audit Staff—The intent of 
this standard is to produce an envi- 
ronment wherein the audit organiza- 
tion and audit staff, whether govern- 
ment or public, can provide impartial 
opinions, conclusions, and judg- 
ments. The auditor must be com- 
pletely free from three types of im- 
pairments: personal, external, and 
organizational, and must maintain 
an appearance of independence to 
the degree that others cannot ques- 
tion his objectivity and attitude. 
Public accountants must be inde- 
pendent, as defined in the AICPA 
Code of Professional Ethics. 

The standard also discusses the 
position of governmental internal 
auditors and recommends, in addi- 
tion to the organization’s high place- 
ment, that the staff be free of politi- 
cal pressures and under a protective 
civil-service type of employment. 
internal audit work can then be ac- 
cepted after adequate testing evi- 
dences the validity of the work be- 
ing relied upon. However, internal 
auditors may not be considered in- 
dependent of their employing entity 
by third parties, though their work 
after testing and evaluation may be 
accepted. 

Finally, the standards presume an 
auditor’s independence of a parent 
government organization when the 
auditor 
e is elected, 

e is appointed by an executive head 
of the government and approved by 
and reports to a legislature, or 

e is legislatively appointed, when 
auditing segments of the political 
organization and reporting to the 
legislative body. 
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Also, independence is presumed 
if the auditor is of 
e a level of government other than 
that being audited, 

e a different branch of the same 
government, or 

¢ a different agency or department 
of the same branch of government. 

Due Professional Care—This 
standard relates to the manner in 
which the audit is performed. It con- 
siders all of the other standards that 
are applicable, such as planning, 
supervision, examination, and 
reporting. The standard does not im- 
ply unlimited responsibility for 
disclosure of irregularities, ineffi- 
ciencies, diseconomies, or ineffec- 
tiveness, nor does it imply that the 
audit organization or the auditor is 
infallible. The auditor is not ex- 
pected to give absolute assurance 
that no material impropriety exists. 
However, the auditor must be alert 
for situations or transactions that 
couid be indicative of (1) fraud, (2) 
abuse, (3) illegal expenditures or 
acts, (4) inefficiencies, or (5) ineffec- 
tiveness. The standard does require 
professional performance of a quality 
commensurate with the importance 
of the audit work being performed. 

Auditing is not a substitute for an 
internal control system. These con- 
trols and associated procedures to 
provide protection against irregular- 
ities and improprieties are a man- 
agement responsibility. 

The auditor is expected to use 
good judgment in testing, and in 
reporting and the quality of audit 
work, the level is expected to be ap- 
propriately high. 

Followup on findings from previ- 
ous audits as to corrective action is 
also an essential part of this stan- 
dard. 


Scope Impairments 


The auditor should attempt to 
neutralize factors external to the 
audit organization that interfere 
with the ability of the audit staff or 
the auditor to maintain indepen- 
dence and objectivity. Examples are 
e limitation or modification of the 
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scope or type of audit, 
e interference with the selection or 
application of audit procedures or 
transactions to be audited, 
e denial of access to sources of in- 
formation or to officials, or 
e unreasonable restrictions on 
time. 

Failing an attempt to neutralize 
these factors, the auditor should 
report the limitation. 


Examination and 
Evaluation and 
Reporting Standards 
for Financial and 
Compliance Audits 


During the intervening period be- 
tween the issuance of the original 
standards in 1972 and the present 
time, financial and compliance 
audits assumed greater importance. 
During this interval, public account- 
ants became aware of the govern- 
ment audit standards and earnestly 
attempted to comply with them in 
their audits of government. There 
were many new areas of governmen- 
tal audit of a financial and compli- 
ance nature as the growth of feder- 
ally assisted programs continued. 
Generally, the congressional legis- 
lation creating (or modifying) these 
programs called for audits in com- 
pliance with the standards. There 
seemed to be general confusion as 
to the degree of compliance with the 
audit standards that was intended. 
It appeared that most of these 
audits were of a financial and com- 
pliance nature and public account- 
ants felt uneasy in their omission of 
efficiency, economy, and effective- 
ness aspects, even though the origi- 
nal standards stated that their inclu- 
sion was not a universal requirement. 

The result of this above condition 
was a certain amount of pressure 
from the profession to clarify the 
situation with a set of examination 
and evaluation standards that more 
specifically described the require- 
ments for the usual financial and 
compliance audits performed gener- 
ally by pubiic accountants. It must 
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be assumed, in the absence of nega- 
tive explanatory remarks, that this 
new section also applies to audits 
of financial and compliance aspects 
by government auditors. 

There are three specific major 
parts of this section: (1) the require- 
ment that the AICPA standards are 
a substantial part of the section, (2) 
a series of four augmenting stan- 
dards relating to examination and 
evaluation and comprising parts of 
the original examination and evalua- 
tion standards, and (3) a major 
modification of the original repor- 
ting standards that will apply to the 
financial and compliance audits. 
These standards are described ina 
bit more detail following: 

Inclusion of the AICPA Stan- 
dards—The auditor is referred to the 
most recent codifications and in- 
dividual issuances of the State- 
ments on Auditing Standards pub- 
lished by the AICPA. 

Planning—This standard empha- 
sizes the single audit concept and 
provides that auditors plan the 
audits so as to serve the needs of all 
government users. The planning 
should also consider the steward- 
ship responsibilities of the govern- 
ment that exceeds the impact on 
financial statements. This single 
sentence could bring into the finan- 
cial and compliance audit appropri- 
ate aspects of management stew- 
ardship (economy and efficiency) 
and program stewardship (effective- 
ness). In effect, the financial and 
compliance auditor continues to be 
responsible for these aspects of the 
audit when and if they are material 
to the operation being audited. 

Legal and Regulatory Require- 
ments—This standard describes 
the compliance aspect of the audit. 
Because of the importance of stat- 
utes, regulations, and ordinances in 
the operation of governmental units, 
the auditor is required to consider 
this aspect. Also, because of the 
financial impact of noncompliance, 
the auditors are to satisfy them- 
selves that there are no failures to 
comply that would materially affect 
financial statements. Additional 
assurance is required to determine 


that there was proper cost distribu- 
tion to grant programs. 

It would appear from the language 
of the standard that there is no re- 
quirement for determining if there 
was noncompliance with statutory 
requirements that have nonfinancial 
impact. 

Working Papers—This standard 
covers much of the material that it 
must be assumed was contained in 
sections of the AICPA standards in- 
corporated by reference. It does add 
a Stipulation on the exchange of 
workpapers between government 
units so as to eliminate duplication 
of work. It also provides for ex- 
change of or use of workpapers be- 
tween public accountants and gov- 
ernment auditors. A series of four 
qualitative requirements as to con- 
tent, completeness, legibility, and 
materiality is also included. 

Fraud, Abuse, and Illegal Acts— 
Auditors auditing financial and 
compliance aspects shall be alert to 
the possibility of fraud, abuse, and 
illegal acts and, if necessary, extend 
audit procedures to identify the ef- 
fect on financial statements. The 
standard repeats the usual dis- 
claimer as to an audit guaranteeing 
that no improprieties exist or the 
subsequent discovery of such im- 
proprieties implying that audit work 
was inadequate. 

Distribution of Audit Reports— 
Reports are to be distributed to in- 
terested officials as well as to ap- 
propriate officials of client organiza- 
tions and to those officials respon- 
sible for taking action. Copies 
should also be made available for 
public use. Engagement letters for 
external auditors and the organiza- 
tion’s policies for internal auditors 
should provide for this distribution. 

Statement on Auditing Standards 
Followed—A statement should be 
in every audit report as to the stan- 
dards followed in the audit. This 
statement should refer to the gov- 
ernment audit standards, the AICPA 
audit standards, or both. 

Statement on Compliance and 
Fraud, Abuse, or Iilegal Acts—The 
auditor’s report should contain 
statements of positive assurance on 
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the items tested and negative 
assurance on the items not tested. 
It should also identify material in- 
stances of noncompliance, fraud, 
abuse, and illegal acts. 

Positive assurance implies con- 
formance to laws and regulations. 
Negative assurance implies that 
nothing came to the auditor’s atten- 
tion to indicate noncompliance. 
Only items of material noncompli- 
ance should be considered and the 
statement should be put in proper 
perspective. 

The discovery by government ex- 
ternal auditors of evidence of fraud, 
abuse, or illegal acts should be 
reported to top management, gov- 
ernment law enforcement officials, 
and officials of agencies providing 
resources. Public accountants need 
only notify the client agency. Inter- 
nal auditors should notify the top 
management officials of the auditee 
agency. Separate reports should be 
prepared for these findings whether 
material or not. Release to the pub- 
lic should be made only with legal 
concurrence. 

Statements on Internal Account- 
ing Control—Financial and compli- 
ance audits will not require any ad- 
ditional audit effort for the review of 
internal accounting controls other 
than that required as a part of a nor- 
mal financial and accounting audit. 
Reports will identify 


e significant internal 

controls, 

e controls that were evaluated, 

© controls that were not evaluated, 

and 

e material weaknesses disclosed. 
The study of internal accounting 

controls should follow the require- 

ments in the AICPA Standards. 


Other Reporting—Material defi- 
ciencies not disclosed in reports on 
financial and compliance audits 
should be covered in separate 
reports. 


Privileged and Confidential Infor- 
mation—The report should describe 
the nature of information omitted 
from the report and the requirements 
of jaw or regulation that preclude its 
inclusion. 


accounting 
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The Examination and 
Evaluation Standards 
for Economy and 
Efficiency Audits and 
Program Results 
Audits 


The standards related to the con- 
duct of the field work audits speci- 
fied are included in this classifica- 
tion. There are seven standards, in- 
cluding the two new standards men- 
tioned earlier: 

Planning—Planning is a basic 
management function, and it applies 
to audit as it does to other functions 
of the organization. Students of 
management agree that most any 
operation must be planned to be ef- 
ficiently and effectively conducted. 
One of the reasons for planning is 
the necessary coordination so that 
audit steps performed by various 
parts of the audit team can be prop- 
erly articulated and so that the audit 
objectives can be met. Also, the 
broad-scope audit requires more 
planning than purely financial 
audits because of the complexity of 
the operation audited and the audit 
process itself. 

Planning applies to coordination 
with other audit staffs, to the per- 
sonnel to be used, the work to be 
performed, and the form and content 
of the report. Planning for work to be 
performed includes the development 
of audit guides and audit programs 
to serve as controls of the audit 
process. 

Finally, the planning should con- 
sider the potential uses and users of 
the audit information. The audit work 
and the report should be responsive 
to all. 

The planning should provide for 
the use of the work of other auditors 
after assuring the credibility of the 
other auditors and the quality of 
their work. Additionally, as auditors 
are working together to a greater 
degree, access to working papers is 
taking greater importance. This too 
must be planned. 

Supervision—This standard is 
essential to all audits so as to pro- 
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vide that personnel are being prop- 
erly used in the correct skill mixes 
and that they are properly perform- 
ing essential work. Supervision 
should ensure that 

e there is conformance to the audit 
standards, 

e the audit program is being fol- 
lowed, 

e workpapers adequately support, 
findings and conclusions, 

¢ workpapers contain adequate in- 
formation for report writing, and 

e the audit objective wili be achieved. 

Legal and Regulatory Require- 
ments—The standards contain the 
provision that the governmental au- 
ditor should examine and evaluate 
operation so as to determine com- 
pliance to statute and regulation. 
All organizations must respond and 
be compliant to not only the stat- 
utes and regulations of the govern- 
ments within which they exist and 
operate, but also to organizational 
policy, procedures, directives, and 
to controls, such as budgets. 

The auditor must test the opera- 
tions to determine that there are no 
material deviations from the particu- 
lar restrictions, and if there are, the 
deviations must be identified, to- 
gether with descriptions of its effect. 

Internal Control—The internal au- 
ditor in both the public and the pri- 
vate sectors is interested in the 
internal controls established for 
operational poses (covered in the 
preceding section). In operational 
auditing, however, the auditor is in- 
terested in how well the controls 
provide for efficient and economical 
operations, ensure compliance with 
procedures, and how well the con- 
trols affect the achievements of 
results that are stated or implied by 
charter, by directives, or by other 
means. Governments have a contin- 
uing need for effective internal con- 
trol systems because of the lack of 
administrative continuity caused by 
changes in elected legislative 
bodies and appointed administra- 
tive organizations. 

The auditor reviews the organiza- 
tion operations to assure that the 
appropriate control elements are 
present and properly functioning. 
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External auditors should consider 
internal audit operation and atten- 
tion to other internal controls in per- 
forming their reviews. Internal audit 
is an essential element of the inter- 
nal control system. Thus, internal 
audit work can be used to provide 
assurance that the control system 
is effective. The auditor is also inter- 
ested in determining whether infor- 
mation provided from the controls is 
being utilized in decisionmaking 
and in taking corrective action. 

Although the auditor should be a 
specialist in control systems, it is 
not intended that an examination of 
all control systems be the objective 
of the audit. The important thing is 
to concentrate on those controls 
that are necessary to the accom- 
plishment of the organization’s ob- 
jective or on those controls that are 
or should be active in operations 
that give evidence of deficiencies. In 
the latter case, the auditor is inter- 
ested in why the controls have 
broken down to allow the deficient 
condition to exist. 

Auditing Computer-Based Sys- 
tems—This standard provides that 
auditors shall participate in the 
design and development of new 
data processing systems and signif- 
icant applications and modifica- 
tions. Auditors shall also review 
general controls to determine that 
they comply with management direc- 
tion and legal requirements and that 
the controls are operating effective- 
ly as to reliability and security. 
Finally, auditors shall review appli- 
cation controls to assess their relia- 
bility in processing data. 

Where systems are audited that 
did not have audit review during 
development, the auditors should 
audit sufficiently to assure the in- 
tegrity of the system. The standard 
also requires that auditors alert 
management to the potential disad- 
vantages of not having audit review 
during the development phases, 
specifically as to controls, audit 
trails, and compliance with good ac- 
counting practice. 

Evidence—Evidence (physical, 
testimonial, documentary, and ana- 
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lytical) should be sufficient, com- 
petent, and relevant. Sufficiency is 
the presence of enough factual, ade- 
quate, and convincing information 
to lead a prudent knowledgeable 
person to the same conclusion as 
the auditor. Competent evidence 
should be reliable and the best at- 
tainable through reasonable audit 
methods. The auditor should keep in 
mind that independent sources are 
the best source of reliability, that 
direct evidence obtained through 
personal observation is better than 
indirect evidence, and that original 
data are better than copies. 

Relevance refers to the direct rela- 
tionship to the issue being examined. 

Evidence placed in working papers 
is the link between the auditor’s in- 
vestigation, evaluation, and report. 
It thus assumes great importance. 
The working papers should be com- 
plete, accurate, clear, understanda- 
ble, legible, neat, and relevant. 

Evidence should be safeguarded 
and retained for such periods as are 
necessary to assure that all legal 
and management requirements have 
been met. 


Fraud, Abuse, and Illegal Acts— 
This standard holds that the auditor 
will be alert to situations, transac- 
tions, or actions that could indicate 
the presence of fraud, abuse, or ille- 
gal or improper activities. The audi- 
tor should plan his audit to disclose 
such acts and resulting illegal or 
wasteful expenditures. If indica- 
tions of such malfeasance are evi- 
dent, the auditor will expand the 
testing and investigation proce- 
dures to the extent necessary to 
identify the effect on the operation 
or the entity. 


Much of the required activity is 
called for under other standards. 
This standard is important because 
of the objectives of the standard 
and the sensitive substance of the 
object of the audit. 

The standard is clear in its lan- 
guage that audit will not guarantee 
the absence of improper or illegal 
acts, nor will subsequent discovery 
of such acts indicate improper or in- 
effective auditing. 


Reporting Standards 
for Economy and 
Efficiency Audits and 
Program Results 
Audits 


There are four standards in the re- 
port classification. These four stan- 
dards cover (1) the form of the report 
(written), (2) the distribution of the 
report to appropriate officials as 
described in the prior section on fi- 
nancial and compliance audits, (3) 
the timeliness of the report, and (4) 
the content of reports as to charac- 
teristics. 

With the progress of the audit into 
areas of management and opera- 
tions, along with the interest of 
managers in efficiency and econ- 
omy and in achieving program 


results, the audit report assumes 
more significance. It is not just a 
documentation of the work accom- 
plished; it also serves as an analyti- 


cal document explaining a number 
of important points, such as 

e the criteria used and their sources, 
e the background of the operations, 
e the conditions that were found, 

e the extent of the deviations from 
the criteria or standards, 

e the causes of the deviations, both 
Surface causes and underlying 
causes, such as policy problems, 

e the impact or significance of the 
deviations, and 

® suggestions and recommenda- 
tions for resolving the problems 
found. 

A report so structured serves as a 
management tool to early pinpoint 
those areas needing corrective 
action. 

Form—Written reports are to be 
used because they serve as a per- 
manent record of the audit, they are 
less susceptible to misunderstand- 
ings, and they provide the same 
basic information to all readers. 

Distribution—The reports are to 
be submitted to appropriate offi- 
cials of auditee organizations, to 
client officials, to those who will 
take action on findings, and those 
for whom the audit will provide sub- 
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stantive useful information. 

Timeliness—Reports, to be effec- 
tive, should be issued as soon as 
possible after the completion of the 
examination and evaluation work. 
Late publication resulting from the 
desire to achieve precision in the 
report should be avoided. Consider- 
ation should be given to the trade- 
offs of precision and accuracy in 
favor of timeliness. Interim reports 
should be used when there is an im- 
mediate need for the early reporting 
of material findings. 

Report Contents—Reports of 
audits of economy and effectiveness 
and of program results shall include: 
e An adequate description of the 
scope and objectives of the audit to 
give the reader proper perspective. 
e A statement that the audit was 
conducted in compliance with gen- 
erally accepted audit standards. 

e A description of material weak- 
nesses in internal controls. 

e Positive and negative assurances 
as to compliance with applicable 
laws, regulations, and statutes as 
described in the earlier section on 
reporting for financial and compli- 
ance audits. Minor procedural non- 
compliance items, not illegal, need 
not be reported. 

e Reporting on fraud, abuse, and il- 
legal acts should be described in 
the earlier section on reporting for 
financial and compliance audits. 

e Audit reports should contain rec- 
ommendatons whenever significant 
improvements in audited entities is 
possible. Recommendations should 
be constructive in tone and relate to 
operational and compliance aspects. 
Auditors, in subsequent audits, 
should disclose the status of recom- 
mendations for which management 
has directed action. 

e The report should contain the 
views of responsible officials of the 
audited entity. The views should in- 
clude the officials’ reaction to the 
audit findings and their plans for im- 
plementing the findings. Auditors 
should express their basis for reject- 
ing opposing opinions when appro- 
priate. Promises of corrective action 
should not be justification for drop- 
ping a significant finding. 
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e A description of significant ac- 
complishments should be provided, 
especially where they can be used 
elsewhere. 
e Issues needing further 
should be identified. 
e Privileged or confidential informa- 
tion that has been omitted should 
be identified along with the reasons 
for such omission. 

Report Presentation—All reports 
shall: 
e Present factual, supported data 
accurately and fairly. Broad conclu- 
sions shall be supported by ade- 
quate examples of deficiencies. 
e Present findings and conclusions 
in a convincing manner. 
e Present findings objectively in- 
cluding sufficient information to 
provide proper perspective. 
e Be written in language as clear 
and simple as the subject matter 
permits. Technical terms should be 
clearly defined. Reports should be 
properly organized and illustrated. 
¢ Be concise but complete enough 
to be understood. 
e Be complete so as to provide ade- 
quate information, including back- 
ground, for management decisions. 
Conclusions should be specific, not 
implied. 
e Place emphasis on improvement, 
rather than criticism of the past. 
There should be a constructiveness 
of tone throughout the report. Lan- 
guage that generates defensiveness 
or opposition should be avoided. 


study 
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Governmental Audit 
Standards: Study 
Design Teams Can Help 
Meet Auditor 
Qualification Standards 


A previous GAO Review article, 
“Governmental Audit Standards: Ef- 
fect on Evidence Collection and 
Analysis,” Winter 1982, discussed 
the evidence collection and analysis 
implications of the standards for au- 
ditors and audit organizations. The 
article suggested that if auditors 
and audit organizations expanded 
their work to include broad-scope ef- 
forts, such as economy and effi- 
ciency and program results audits, 
both the individuals and organiza- 
tions would have to develop in- 
creased knowledge of sampling and 
other statistical techniques, new 
data collection techniques, and 
computer analysis of data collected 
during the audit. The article con- 
cluded “that the organization and 
individuals in the auditing profes- 
sion will have to undergo a reorien- 
tation in professional development 
if the objectives of the. ..standards 
are to be achieved.” 

This article continues the discus- 
sion begun in the previous article by 
focusing on a mechanism—the study 
design team—that can help assure 
auditing organizations that they are 
using the most appropriate skills 
and knowledge in their audits. The 
information presented here is based 
on the General Government Division’s 
experience with study design teams 
during a 6-month period starting 
July 1, 1981. This article discusses 
the design team concept in terms of 
(1) purpose, (2) composition, (3) func- 
tion, (4) the methodology needs 
assessment checklist, and (5) early 
results of design team use. 


Purpose of the Study 
Design Team 


The following passage from the 
standards makes clear the evolving 
nature of expanded scope audits 


and their requirements for new 
knowledge and skills: 


The audit standards are more than 
the mere modification of current 
practices, tailored to existing audit 
capabilities. They include concepts 
and areas of audit coverage which 
are still evolving and are vital to the 
accountability objectives sought in 
auditing governments and their 
programs. 


The responsibility for assuring 
that auditing under the standards 
does not mean “business as usual” 
is placed on both the auditor and 
the auditing organization. For exam- 
ple, the first general standard states: 
Qualifications: The auditors as- 
signed to perform the audit must 
collectively possess adequate pro- 
fessional proficiency for the task re- 
quired. A further elaboration makes 
the auditing organization’s role even 
clearer: 


The qualifications maintained here- 
in should apply to the skills of the 
audit organization as a whole and 
not necessarily to individual audi- 
tors. If an organization possesses 
personnel, or hires outside consul- 
tants, with acceptable skills. ..each 
individual member need not possess 
all these skills. 


Possession of or access to these 
skills by the auditing organizations 
will not, however, assure their use. 
Experience has shown that many 
auditors will not take advantage of 
the quality-eenhancement or cost- 
reduction potential of these skills, 
even when readily available, either 
due to their failure to recognize situ- 
ations where the skills are useful or 
because of a reluctance to work in 
unfamiliar environments. When this 
occurs, auditing organizations 
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ought to recognize and correct the 
situation. 

The major purpose, then, of the 
study design team concept is to pro- 
vide an implementing mechanism 
for the audit qualifications stan- 
dard. As such, the approach aids 
management in 
® assuring that audits use the most 
appropriate methodologies and 
other skills; 

e assuring that each audit consid- 
ers the feasibility of using data 
processing and statistical tech- 
niques to reduce cost and staff re- 
quirements; 

e determining which skills and 
methods have the greatest applica- 
bility to the audit organization’s 
work, the frequency with which each 
is used, and, if necessary, the rea- 
sons for shortfalls between applica- 
bility and use; 

e alerting the assigned staff, as 
early as possible in the audit, to the 
potential benefits of using skills 
and methods they may not possess, 
allowing time for other resources to 
be obtained to meet assignment 
needs; 

e documenting the use of the vari- 
ous skills and methods for the pur- 
pose of making resource allocations 
and determining staff development 
requirements; and 

e determining the extent of any 
methodology-related limitations 
which would require disclosure in 
the resulting audit report. 


Composition of the 
Study Design Team 


The composition of GGD’s study 
design teams generally has been 
determined by both the type of audit 
being done and by the audit objec- 
tives. Thus, an audit of conditions in 
the savings and loan industry re- 
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quired a study design team member 
with skills in economic analysis and 
specialized knowledge of financial 
markets. However, experience shows 
that most design teams are able to 
accomplish their objectives with in- 
dividuals having the following mix 
of skills: 

e subject matter or programmatic 
expertise; 

e legal expertise; 

¢ methodological expertise, which 
could be any mix of skills, although 
usually the requirement can be met 
by an individual trained in quantita- 
tive methods and who has knowl- 
edge of computerized data retrieval 
and analysis; and 

¢ auditing expertise, supplied by 
the staff having responsibility for 
conducting the audit. 

In some cases, as more informa- 
tion is developed about an audit’s 
objectives, certain skills and some 
design team members are found to 
be unnecessary to the job. In other 
cases, new team members with new 
skills are added to meet an audit’s 
requirements. The key point here is 
that the design team, complete with 
its members’ atypical and typical 
auditing skills, can make a formal 
methodology review on each assign- 
ment and identify the particular 
skills needed to conduct the audit. 
Thus, decisions relating to the work 
itself and the methods to be used 
are made only after receiving input 
from individuals possessing a broad 
range of differentiated skills. 


How the Design Team 
Concept Functions 


Under the study design team con- 
cept, meetings take place before the 
auditors request approval to go into 
full-scale implementation. Division 
practice has been to provide design 


team members with information on 
the proposed scope and audit objec- 
tives prior to the initial design team 
meeting. This information, together 
with the team’s discussions, helps 
determine whether the assignment 
would benefit from “nontraditional” 
auditing skills. Design meetings 
held early enough in the assignment 
allow staff to consider the input by 
the other team members and, when 
necessary, to adjust the proposed 
approach accordingly. 

Additionally, holding the meetings 
early in the process provides the 
time required to work out a way to 
obtain the necessary skills. For ex- 
ample, staff on one assignment 
decided a mail survey was the best 
way to collect required data, and 
this need was _ identified early 
enough to obtain the services of an 
individual trained in designing ques- 
tionnaires. On another assignment, 
the early meetings provided time to 
identify and meet the need for a 
computer simulation model. In both 
of these cases, the needs may not 
have been recognized or met if the 
study design team mechanism had 
not been in place. 

The length and frequency of the 
study design team meetings have 
been kept to a minimum. For some 
small audits, usually those with sim- 
ple objectives, individual team mem- 
bers have been telephoned to get 
their reaction to the assignment. 
Typically, however, at least one for- 
mal design team session is held, 
and, based on the results of this 
meeting, subsequent meetings are 
held with only those team members 
whose skills or knowledge warrant 
more extensive discussions. For ex- 
ample, on an audit requiring a com- 
plex statistical sampling plan, the 
initial meeting involved all design 
team members. The subsequent 
meetings were limited to the as- 
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signed staff and those members of 
the design team with sampling ex- 
pertise. Such an approach has held 
to a minimum the amount of time 
spent developing the methodology 
for each assignment, while at the 
same time allowing all team mem- 
bers an active role in determining 
the most appropriate methodology 
for each of the division’s audits. 


Methodology Needs 
Assessment Checklist 


A major part of the study design 
team concept, and its only written 
record, is the methodology needs as- 
sessment checklist. The division di- 
rector and other division officials use 
the checklist information as an aid in 
deciding whether an audit should be 
approved for implementation. Addi- 
tionally, completed checklists, 
when analyzed, provide information 
about (1) the skills and techniques 
used on the various assignments, (2) 
the frequency with which new skills 
and techniques could have been used 
and were not, (3) why the newer 
methods were not used, and (4) re- 
port qualifications necessitated by 
the audit methodology. 

The checklist is organized into 
two major sections. The first con- 
tains general information about the 
audit, such as the job code, the title, 
and the estimated required staff 
days. Other information collected 
under the general section, such as 
the number of locations to be visited 
during the audit, whether the audit 
requires interviews or question- 
naires from 25 or more people, and 
whether the audit will require ob- 
taining the same data from 50 or 
more case files, provides a first indi- 
cation as to whether the assign- 
ment might benefit from sampling, 


computer, or statistical analysis 
techniques. The second section, 
under four major headings, details 
the proposed methodology and the 
results of the design team assess- 
ment. The four headings are (1) 
sampling, (2) standardized data col- 
lection, (3) computer sciences, and 
(4) analytical resources. For each of 
these areas, the team member 
knowledgeable in quantitative tech- 
niques can use the form to develop 
information about whether the 
assignment would benefit from their 
use. If there are indications that the 
assignment would benefit, informa- 
tion is then recorded about how the 
skills could be applied to the audit. 
For example, if an audit has a sam- 
pling application, information is col- 
lected about whether 

e the locations should be randomly 
selected, 

e the cases/individuals (units of 
analysis) should be randomly 
selected, 

¢ a simple sample is required, or 

¢ a complex sample is required. 

After establishing that an audit 
would benefit from using one or 
more of these skills, and after 
recording specifics on how the 
skills apply, the checklist can be 
used to record information about 
whether the skills will be used in the 
audit. In those instances where the 
skills are applicable but the audit 
does not incorporate them, the team 
member can record information on 
the checklist about why the skills 
are not being used. Some reasons 
would include the lack of auditor 
resources, time constraints, and/or 
decisions to reduce the scope of the 
audit. 

The final. type of information 
recorded on the checklist relates to 
report qualifications or potential 
problems resulting from the pro- 
posed methodology. For example, in 


many instances, deciding not to ran- 
domly select locations has brought 
warnings to division management 
that the audit results will apply only 
to the locations actually visited. The 
same decision has also brought 
observations that the assignment 
could not benefit from other statisti- 
cal techniques since a random sam- 
ple is a necessary condition for their 
use. 

As previously indicated, checklist 
preparation is the responsibility of 
the division’s methodology unit, al- 
though it can be prepared by any in- 
dividual with quantitative and evalu- 
ation training and experience. The 
form, once completed, becomes a 
permanent record of the audit’s 
methodology considerations. (Sam- 
ple excerpts from the checklist ap- 
pear at the end of this article.) 


Some Tentative 
Results 


As of December 1981, 10 assign- 
ments have passed through GGD’s 
entire design team process and are 


in the implementation phase. 
Another 10 have progressed to the 
point where some input has been 
received from study design team 
members. Initial results of the study 
design team approach indicate that 
the auditors responsible for the 
assignments spend more time con- 
sidering the methodology aspects 
of jobs than in the past. Also, the 
methodology considerations sur- 
face earlier in the assignments. 
Because the design team concept is 
seen as evidence of increased em- 
phasis by division management on 
the importance of methodology in 
assuring audit quality, interest in 
knowing about and working with the 
newer skills has increased. For ex- 
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ample, the following are some 
observations on the design team 
concept from auditors who partici- 
pated in the process: 


The [design team] meeting proved 
quite useful in surfacing and addres- 
sing various concerns, reservations, 
and potential problems. In particu- 
lar, several issues were raised on 
the assignment’s scope and meth- 
odology.... As a result of these 
concerns, the planning phase was 
extended one month to firm up our 
program selection, grantee visits, 
and implementation time frame in 
terms of both staff and calendar 
days. 


* * & 


Overall, the design team concept is 
an excellent approach to scoping 
and planning our assignments. For 
this particular assignment, the 
design team was instrumental in 
developing issues and then elimi- 
nating those that were not attaina- 
ble because of our inability to collect 
the needed evidence to support our 
positions. Thus we eliminated 
issues that. ..we may have expend- 
ed a great deal of time on before we 
found they were impractical to pur- 
sue.... Also, we have saved a great 
deal of time on this assignment by 
using a data collection instrument 
and the computer to analyze our 
data. 


The [design team meeting] affirmed 
that the conceptual design and 
methodology [were] appropriate to 
the issues we were asked to address. 
However, it became evident that im- 
provements needed to be made in 
presenting the analytical framework 
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in a form that better demonstrates 
how it addresses the issues con- 
tained in the legislation... . In addi- 
tion, the [process] pointed up the 
need to emphasize the potential 
budgetary impact of changing the 
matching rate structure. It was gen- 
erally felt that this issue needed to 
be given more prominence even 
though the primary issue is con- 
cerned with the matching rate struc- 
ture itself. 


There were also some negative 
comments on the process. Auditors 
on one assignment felt that the 
design team members spent too 
much time arguing among them- 
selves over matters irrelevant to the 
audit. The same group of auditors 
also suggested that some staff time 
was wasted because design team 
members were tied up in long meet- 
ings when they were needed only for 
an hour or so. The auditors sug- 
gested that smaller, more individ- 
ualized meetings would alleviate 
both of these problems, concluding 
that “the design team concept has 
merit and should be continued.” 

Auditors on another assignment 
raised what will probably be the 
most frequently occurring problem 
in introducing new techniques into 
auditing organizations—that of 
placing responsibility for how an 
audit should be done. While recog- 
nizing that the “design team is an 
excellent approach to scoping and 
planning” assignments, the audi- 
tors observed: “The only drawback 
is that the design team members 
must realize that their role is to only 
provide advice and that the final 
decisions on an_ [assignment’s] 
direction lie with the evaluator-in- 
charge and the group director.” This 
problem likely will be resolved 
through more experience with the 


design team concept, when auditors 
develop more familiarity with the 
newer techniques, or perhaps 
through more intervention by higher 
levels of division management. 


Preliminary statistics on the ap- 
plicability of the new skills to the 
division’s work are also becoming 
available. They show that 4 of the 10 
audits could benefit from using 
sampling techniques, 5 from struc- 
tured instruments, 6 from computer 
science skills, and 5 from applying 
analytical resources. The statistics 
also indicate the extent to which 
considerations of methodology re- 
quire qualifying the audit findings. 
For example, 2 of the 10 approved 
assignments will produce results 
not applicable to other situations. 
The other eight assignments will 
result in reports where the audit fin- 
dings apply only to the locations 
visited, not to the agency or pro- 
gram as a whole. With more experi- 
ence and information, the division 
will be better able to determine if 
new statistical or data collection 
techniques could be used to obtain 
broader audit coverage. 


Observations and 


Conclusions 


Governmental Audit Standards 
recognize that new skills and 
methods will be needed by auditors 
and audit organizations to do ex- 
panded scope audits. However, 
these nontraditional skills and 
methods probably will not be used 
unless auditing organizations devel- 
op mechanisms like the study 
design team which assure that each 
assignment is evaluated in terms of 
skill and method applicability. 
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Excerpts from the 
Checklist 





STANDARDIZED DATA COLLECTION 
Yes = 1 No = 2 


Would the assignment benefit from the use of standardized data collection methodologies? If 
yes, continue. 

Type: 

Mail questionnaires 

Structured interviews 

Phone survey instruments 

Computer assisted telephone interviews 

Other phone interviews 

DCI’s (pro forma workpapers) 

Agency computer systems 

Other 


COC. 6 








O 





Use of standardized collection techniques on the assignment 
Yes = 1 No = 2 


Will standardized techniques be used? 

If not, why? 

e Design staff not available 

e Field resources not available 

e Time not available 

e Objective downscoped (decision to do work that is less than equivalent to that obtainable 
using stardardized techniques) 
Computer staff not available 
Other 











COMPUTER SCIENCES 
Would the job benefit from the application of computer sciences? 


If yes, continue. 

Requires extensive data manipulation (producing schedules, summaries, etc.) 

Requires data availability at several GAO locations (utilize switching capability) 
Requires output of raw data for computing sampling errors 

Requires capability to obtain data from agency computer systems 

Requires all data to be weighted due to complexity of sample 

Requires an evaluation of reliability of agency data systems output 

Requires an evaluation of proposed procurements of computer systems or equipment 
Requires an evaluation of agency (or other) studies, including feasibility studies, of com- 
puter system needs 

Requires an evaluation of the efficiency of existing or proposed computer software 
systems (i.e., report generators, payroll, etc.) 


SS, tasJCiOcsts. GJ 
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Training 


Civil 


Rights Counselors 


The EEO counselor’s role and title 
have changed, and the change is 
more than cosmetic... Civil rights 
counselors, as they are now known, 
have been charged with expanding 
their roles in the work place. By 
keeping regional management in- 
formed of office developments, 
counselors can identify potential 
problems and help find solutions. If 
a counselor can intervene early 
enough, problems can be fore- 
stalled or resolved with minimal 
disruption of the office routine. This 
represents a radical departure from 
the counselor’s traditional role of 
dealing with problems as they arise. 
With this basic philosophy, it’s not 
surprising that the Civil Rights Of- 
fice’s 2-day training course empha- 
sized that civil rights counselors 
can make a difference. 


To begin to make that difference, 
the trainers, the Civil Rights Office 
director, and the participants had to 
define both the counselor’s tradi- 
tional and expanded roles. To do 
that, participants had to answer the 
following questions: 


e What is discrimination? 

¢ How does discrimination differ 
from reverse discrimination? 

¢ What is meant by the “perception 
of discrimination?” 

e Why is it difficult to separate 
perceived discrimination from real 
discrimination? 

e What legal mandates exist to 
combat discrimination? 

e What is the difference between 
EEO and affirmative action? 

e What are the complainant’s 
rights? 

© How do you protect the rights of 
the alleged discriminating official? 
¢ How do you maintain objectivity 
in an emotionally charged situa- 
tion? 

¢ What are the steps in conducting 
an inquiry? 

¢ How does handling an individual 
complaint differ from processing a 
class action complaint? 


Mandated By Law 


An overview of legislation dealing 
with discrimination—including 
seven legal mandates, two ex- 
ecutive orders, and two agency 
orders—answers some of these 
questions and is summarized in 
table 1. 

Virtually every president since 
Truman has placed an antidiscrimi- 
nation mandate on the books. The 
Equal Employment Opportunity 
Commission was established under 
the Civil Rights Act of 1964, Title VII, 
by President Johnson. Although 
EEO and affirmative action are 
often linked, the Affirmative Action 
Program was initially instituted for 
the Government by Executive Order 
11478, under President Nixon. 


It is important to understand that 
since the EEO Act of 1972, develop- 
ment of affirmative action plans is 
also mandated by law. An affirma- 
tive action plan, however, is not a 
quota. |ts sole purpose is to correct 
underrepresentation of any group. 
Rectifying underrepresentation 
does not mean hiring unqualified 
people; merit is still the first con- 
sideration. The actual difference be- 
tween EEO and affirmative action is 
largely semantic because, as one 
trainer put it, ‘affirmative action ex- 
ists to make EEO real.” 


Defining 
Discrimination 


Supplied with the necessary legal 
background, participants discussed 
definitions. How is discrimination 
defined? What forms can it take? In 
its broadest sense, discrimination 
refers to unfair treatment. Legally, 
discrimination is defined as unfair 
treatment based on race, sex, na- 
tional origin, cclor, handicap, age, 
or religion. Six forms of discrimina- 
tion were identified: 
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Legislation 


Table 1 
PROHIBITED DISCRIMINATION 
Based On 


Importance 





Civil Rights Act of 1866 
Civil Rights Act of 1871 
Civil Rights Act of 1964, Title VII 


Age Discrimination Act of 1967 


Vocational Rehabilitation Act 


Civil Rights Act of 1968 


Equal Pay Act of 1963 


Executive Order 11478 


Executive Order 11246 


GAO Personnel Act of 1980 


GAO Order 2713.2 





Race 
Race, sex (class-based) 


Race, sex, national origin, color 


Age (40-65) 


Physical and mental handicaps 


Race, religion, national origin, color 


Sex 


All major forms 


All major forms 


All major forms 


Race, color, religion, sex, national 
origin, handicapping condition, age 


Implementation of 13th Amendment 
Discrimination in employment 


Broad antidiscrimination act; 
EEOC established 


Age not covered under previous 
acts 


Recognized handicap discrimination 


Criminal penalties for employment 
interference 


Recognized sex discrimination in 
pay 


Affirmative Action Program 
authorized 


EEO for employers and Govern- 
ment contractors 


Established an independent per- 
sonnel system for GAO. Provided 
employee safeguards against 
major forms of discrimination. Est. 
GAO Personnel Appeals Board 


Procedures for complaints and 
rights of employees in GAO clearly 
established 





© Conventional (treatment) discrim- 
ination 


Unfair treatment based on race, sex, 
national origin, color, religion, or 
handicap 


e Impact discrimination 


Equal treatment with different ef- 
fects due to background differences 
© Related activity discrimination 

Unfair treatment based on self- 


chosen activities related to title VII 
Status 


¢ Discrimination based on innate 
characteristics 


Title Vil discrimination based on 
race or sex 


© Discrimination based on charac- 
teristics imposed by nature 


Handicap is a major example 


e Discrimination based on charac- 
teristics imposed by society 


Lack of education is a primary ex- 
ample 


Conventional discrimination can 
be detected by studying patterns in 
ratings, hiring, promotion require- 
ments, assignments, training, and 
awards. Impact discrimination can 
include a hiring test, awards requir- 
ing a minimum grade level, or a job 
assignment based solely on height. 
The primary characteristic of impact 
discrimination is that it is exclu- 
sionary. Conventional discrimina- 
tion and impact discrimination can 
both be encouraged by organiza- 
tional systems, so the systems 
must be reviewed and adjusted 


periodically to prevent exclusion. 





Conventional and impact discrim- 
ination can perpetuate underrepre- 
sentation. Another related form of 
discrimination—systemic discrimi- 
nation—also accounts for under- 
representation. For example, a high 
school diploma is mandatory for 
most jobs, which implies a minimum 
standard of proficiency. It is a cut- 
off point for those who can do cer- 
tain jobs and those who cannot. On 
the other hand, the average person 
in the United States reads at the 
fifth-grade level. Although the high 
school diploma serves to exclude 
some people, does that minimum re- 
quirement guarantee a level of pro- 
ficiency? Given the statistics, it 
does not. 


How is underrepresentation 
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determined? Here, numbers become 
all-important. It is not only possible, 
but also at times desirable, to man- 
ipulate figures. Statistics can be 
used to make almost any point, and 
decisions (such as which statistical 
data base to use in determining 
underrepresentation) can make a 
significant difference in the work 
force profile. Those bases, in 
descending order of female and 
minority representation, are (1) the 
general population, (2) the civilian 
labor force, and (3) the relevant labor 
force. 

Participants at the EEO coun- 
selor’s meeting also laid to rest a 
popular misconception about reverse 
discrimination. Reverse discrimina- 
tion has made attention-grabbing 
headlines in the last few years. 
Some groups have been encouraged 
to think that affirmative action has 
substantially reduced their oppor- 
tunities for jobs and promotions. 
The Equal Employment Opportunity 
Commission is committed to equality 
but not at the expense of merit. A 
uniform guideline for computing 
adverse impact is used to prevent 
affirmative action from creating its 
own inequities. For example, if one 
group’s selection rate is above 80 
percent for any reason, the affirma- 
tive action plan must be changed to 
compensate for the other group’s 
shortage. As the course participants 
checked their figures against the 
formula, they could not find any evi- 
dence of adverse impact for white 
males in GAO. This is why it becomes 
essential to distinguish perceived 
discrimination from real discrimina- 
tion. 


Counseling 
Approaches 


As part of the training, participants 
watched two videotaped dramatiza- 
tions of sexual harassment and sex 
discrimination. Aware of subtle dis- 
criminatory behavior, participants 
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moved on to role playing, in which 
each acted as counselor and com- 
plainant. Role playing allowed them 
to understand why certain counsel- 
ing techniques work. 

There are essentially two ap- 
proaches to counseling: directive 
and nondirective. The best approach 
is determined by the information the 
counselor needs. The directive ap- 
proach helps obtain specific infor- 
mation, such as who, what, when, 
where, and how. Overall, the most 
effective counseling approach is the 
nondirective approach. It reminds 
the counselor that the complainant 
has the problem and the counselor 
is there to help find a solution. The 
nondirective approach emphasizes 
listening, asking questions or inter- 
rupting only for clarification, focus- 
ing on the person, making extensive 
eye contact, and maintaining a 
relaxed body position. Since a large 
part of our communication tends to 
be nonverbal, the importance of us- 
ing these techniques in counseling 
situations cannot be overlooked. 


On the last day of the course, par- 
ticipants staged their own drama. 
Everyone played a role, from coun- 
selor to alleged discriminating offi- 
cer. They provided them with an op- 
portunity to synthesize the course 
material. Did the complainant have 
a legitimate complaint? Was the 
counselor’s information accurate? 
Was the complainant advised of his 
rights? Did the counselor adequately 
protect the rights of the alleged dis: 
criminating officer? As a counselor, 
was it possible to settle the com- 
plaint informally? 

In my debut as a counselor, | 
faced a tough complainant. He had 


substantial time in grade and 
thought he had been overlooked for 
a promotion. He felt that the em- 
ployee who got the promotion was 
not qualified and was personally in- 
voived with the manager who made 
the selection. After interviewing 
coworkers and other supervisors 
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and reviewing the selection certifi- 
cate, | concluded that the complain- 
ant did not have as strong a case as 
he stated. The most qualified per- 
son had been promoted. Although | 
could not guarantee the complain- 
ant the promotion he wanted, | did 
secure a promise from his super- 
visor to provide the necessary 
coaching and career development to 
make him more competitive. How- 
ever, the complainant was still dis- 
satisfied and decided to file a for- 
mal complaint. 

A course’s effectiveness can be 
judged by the subtle ways in which 
it changes your life. Although | don’t 
believe that empathy or understand- 
ing can be heightened in a couple of 
hours, | do believe that their devel- 
opment can be encouraged by ex- 
pert guidance. This is precisely the 
kind of exposure that the civil rights 
training course provided. 

Its structure was based on three 
sound assumptions: we all wanted 
to be counselors; we were generally 
interested in people; we were com- 
mitted to solving problems. By pro- 
viding us with a good mixture of 
learning experiences, the trainers 
progressively broadened our under- 
standing, not just of the complaint 
process, but of the frustrations and 
disappointments of modern life as 
well. 

The problems that exist in the of- 
fice are not simply a product of that 
environment; if that were the case, 
the environment could be controlled 
to eliminate specific problems. But 
because each individual brings 
unique perceptions and problems to 
the work place, counselors have to 
be willing to listen and help find 
solutions as well as to anticipate 
and prevent potentia! problems. | 
believe that the ultimate value of the 
counseling process lies in its poten- 
tial to create understanding. 





Patricia K. Moran 


Mrs. Moran is currently GAO’s Information 
Officer. She is a graduate of Marymount 
College and has a master’s degree from 
Catholic University. Prior to joining GAO, 
Mrs. Moran was a communications con- 
sultant for several organizations. Mrs. 
Moran is the recipient of several awards for 
excellence in design, production, and edi- 
torial content of corporate literature, pro- 
motional literature, audiovisual aids, and 
educational materials. 


A Week’s Worth 








MONDAY 


TUESDAY 











WEDNESDAY 


THURSDAY FRIDAY 


fre 























Monday 


Would that | had the good sense 
to consult the astrology chart or 
maybe even the tea leaves before 
coming into the office this morning. 
| would probably have made other 
plans. After a very nice Thanks- 
giving weekend—and a wonderful 
party marking my second son’s 21st 
birthday—|I was in a positive mood. 
A story on the agency in last Satur- 
day’s New York Times took care of 
that. In disbelief, | read my name (a 
definite no-no for public affairs peo- 
ple, whose names are never men- 
tioned) and an incomplete quote 
which raised more questions than it 
answered. | fire off a phone call to 
the reporter who confirms my suspi- 
cion that a copy editor did, in fact, 
cut the story at a point most 
definitely not to my liking. | don’t 
feel any better having told the 
reporter what | think of that kind of 
arbitrary copy editing. | am not an 
advocate of writing letters to the 
editor. They never catch up with the 
people who have read the article in 
question. Still | feel compelled to 
complain about this one, and a let- 
ter seems an appropriate way to 
deal with my frustration. I’ll think it 
over and decide tomorrow. 

| have a brief meeting with Mr. 
Bowsher and Elaine Orr on his 
speech for the American Society for 
Public Administration. Elaine, who 
is the director of GAO’s Office of 
Foreign Visitors and the executive 
director of ASPA’s National Capital 
Area Chapter, had some valuable 
suggestions for the lead which are 
more relevant to that audience than 
what | had proposed. We agreed to 
reorder the points made in the 
speech and devote more time to 


comments on the budget process. 
Phone messages are stacking up by 
noon. Most of them are inquiries 
from reporters on our report on con- 
gressional reporting requirements. 
By the end of the afternoon, I’ve got- 
ten in touch with all of them, 
answered their questions or put 
them in touch with the person in the 
agency who could. Dictate a few let- 
ters for Mr. Bowsher’s signature ac- 
cepting invitations for future 
speeches and ordered additional 
photographs of his swearing in that 
he had asked for. I’m still angry 
about that story! Best therapy might 
be a little Christmas shopping. | 
remember that stores are open late 
downtown. Actually | just want to 
distract myself from a blue Monday. 
I’m pleased to find a special present 
for my daughter that I’ve been look- 
ing for. | arrive home to discover the 
dishwasher is leaking—a lot. The 
end of a perfect day! The only sensi- 
ble option is to go to bed. | do. 


Tuesday 


Before leaving home, | telephone 
Mr. Higgins, who says the dish- 
washer is probably not a major prob- 
lem. He will come over this evening. 
Top of the priority list today is 
reaching Monika Jensen, a producer 
for 60 Minutes who is working ona 
segment for the program on the Tun- 
nels and Reservoirs Project, particu- 
larly the completion of the Chicago 
tunnel that has raised much contro- 
versy. She would like to include an 
interview with Dan White on the 
GAO position on the project. | finally 
track her down, and she tells me 
that the segment is on schedule. 
She will set a definite time for the 
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White interview sometime in Decem- 


ber. Brooks Jackson from the Wal// 
Street Journal wants a briefing on 
our Department of Defense Task 
Force. He’s particularly interested 
in new information on waste on 
DOD programs. | set up a meeting 
with Werner Grosshans for this 
afternoon at 3 p.m. | draft a letter to 
the New York Times. | review the 
material for this week’s issue of 
Management News with Laura 
Kopelson. We agree that Mr. 
Bowsher’s ASPA speech will be the 
lead, particularly the portion that 
calls for the creation of a commis- 
sion to review the budget process. 


The weather is dreadful. which 
prompts Karen Lukinson and me to 
meet in the GAO cafeteria for lunch 
rather than brave the rainy day. 
Karen, a film consultant, has just 
finished a secretary recruiting film 
for GAO, and I’m anxious to find out 
if she’s pleased with the product. 
She says there is still considerable 
editing to do but she feels it will 
work out well. We discuss a new 
script for a general GAO orientation 
film. She’s looking for the right nar- 
rator. We talk about a number of 
people. | think commentator Eliza- 
beth Drew would be an excellent 
choice. Karen is interested in ex- 
ploring her availability, and I’ll be 
happy to do that for her. Gives me a 
chance to catch up with an old 
friend, Kathy Glover, who is now on 
Drew’s staff. 


In the early afternoon | get to the 
in-box. Spend an hour or so sorting 
through that material. The balance 
of the day is spent with reporter 
Brooks Jackson and PLRD’s Werner 
Grosshans and Jim Morris. It’s an 
excellent briefing—good questions 
and straightforward answers. I’m 
still astonished at the sheer volume 
of material that this agency can pro- 
vide for journalists. Reporters who 
understand how to use GAO have 
found the proverbial gold mine. Hig- 
gins calls to say the dishwasher 
needs one new part which he has 
with him. That’s fixed. No big hurry 
to get home this evening. Daughter 
Fran has an evening class and 
daughter Mimi has swim team prac- 
tice. Looks like a pick-up dinner. 
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Wednesday 


Elaine has revised Mr. Bowsher’s 
speech for ASPA and has gotten 
some additional language from Milt 
Socolar. The text reads well, and Mr. 
Bowsher is satisfied. Our secretary 
Shirley Graham is typing his reading 
copy, which | must get to him by 
noon. Pat Tyson of our office re- 
minds me that a report on Potomac 
River pollution hazards is about to 
go to printing. She’s working on a 
release. Mort Mintz from The Wash- 
ington Post calls to tell me that he’s 
starting work on what he hopes will 
be a major weapons system story. 
He needs certain unclassified 
reports and would like to schedule a 
meeting with Walt Sheley. I'll make 
arrangements for that when Walt re- 
turns to the office on Friday. | return 
a call to Wendy Wheat at the Peace 
Corps. As an avocation, Wendy is 
heavily involved in the issue of 
world hunger. She’s beginning to 
organize a benefit concert at the 
Kennedy Center in April. She hopes | 
can help out on the publicity com- 
mittee. | explain that my free time is 
in short supply, but we will meet for 
lunch one day next week and see 
what we might work out. She’s get- 
ting some interesting people 
together. Also, | return a call from 
Nikki Burr, who reminds me that my 
birthday is fast approaching, and we 
make a lunch date to mark the grand 
event. Her Bureaucrat doll is selling 
like crazy and she’s gotten mar- 
velous press coverage for it. She 
said she would save the specifics 
on that for lunch. 


Mr. Bowsher’s speech is finished 
reasonably close to deadline. | 
deliver the text and call FPCD asso- 
ciate director Roz Kleeman to make 
arrangements to meet her at the 
ASPA luncheon to hear Mr. Bow- 
sher. The summaries and digests of 
three reports which Laura and Pat 
have edited are waiting for me to 
review. | put aside some phone 
messages to take care of that. One 
title is troublesome—too wordy and 
complex. The auditor and | talk it 
over and compromise. It’s a better 
one than the original although not 
as direct as | would like it to be. I’m 
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running late for a lunch meeting 
with an old friend at the Capitol Hill 
Club. But a cab comes along right 
away so I’m not very late. | should 
have postponed lunch to another, 
less busy time. I’m relieved that my 
luncheon companion has an early 
afternoon appointment. Back in the 
office, | telephone Mike Causey to 
discuss Mr. Bowsher’s’ speech. 
There’s some good material in it on 
GAO support for raising executive 
pay. Mike assures me he will do his 
best to cover the speech, but I’m not 
overly optimistic. He’s just back 
from vacation. 

| spend some time with Laura go- 
ing over a special issue of Manage- 
ment News on the GAO budget for 
1982. There’s been some confusion 
in the agency on just where we stand 
moneywise and how our people 
might be affected by the dollar cut- 
backs. This information must be 
clearly and carefully presented. 
Laura checks it out with controller 
Dick Brown and Milt Socolar, and it 
appears we are on target. 

| call to verify my son Patrick’s 
plane reservations from Denver to 
Washington on December 19. Every- 
thing’s in order except the price of 
the ticket, which has gone up. | could 
have used that extra $100! I’m get- 
ting excited about having Patrick 
come home. It’s been almost a year 
since I’ve seen him. Spent the 
balance of the afternoon on reports. 

| meet Jeanne Young at the Press 
Club for dinner. We talk at length 
about the demise of the National 
Association of Educational Broad- 
casters where | worked very happily 
for a number of years. I’m very sad 
about that organization going 
under. | met some of the brightest, 
most dedicated people I’ve ever 
known through NAEB, and I’m sorry 
I’ve lost touch with so many of them. 


Thursday 


The morning is routine. | get 
through the in-box and catch up on 
some magazine reading I’ve put 
aside. | clear up one point for Mr. 
Bowsher that he raised about one 
part of his speech. | meet Roz Klee- 
man at the ASPA registration desk 
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at 12:30 p.m. to pick up my luncheon 
ticket. The luncheon crowd numbers 
about 300, and they give Mr. Bowsher 
a warm reception. As a speaker, he 
has one major asset. He likes to do 
it, and that comes through. He also 
has a good sense of humor and uses 
it. ’m a stranger to this group but 
meet and chat with a number of peo- 
ple. Among them is ASPA president 
Chet Newland, who asks for a copy 
of Bowsher’s text for partial publica- 
tion in The Public Administration 
Times. 

l’ve kept notes on my activities 
this week to prepare this piece for 
the GAO Review. When | return to 
the office, | begin to put it together. 
As usual, it takes longer than | an- 
ticipate. Writing always does. By the 
end of the day, I’m still not quite 
finished, but there is tomorrow 
morning to complete it and still 
make Hannah Fein’s GAO Review 
deadline. | stop to do some grocery 
shopping on the way home. Mimi 
and Fran decide it’s a good night for 
a movie. We go to see Reds. Very 


fine film which we all enjoy. 


Friday 


| make reservations for a Washing- 
tonWomen’s Network luncheon on De- 
cember 17 to hear Nancy Reynolds 
from Bendix Corp. and Antoinette 
Ford from AID. WWN runs good pro- 
grams. Membership in that organi- 
zation is very worthwhile. | also ar- 
range to attend a Marymount alumni 
reception at the school in Arlington 
on December 14. I’m really out of 
touch with that group, but with my 
daughter’s recent interest in the col- 
lege, | will go to the alumni func- 
tions when | can. She would like to 
go, too. 

| talk again with Mike Causey. | 
think he will probably carry some- 
thing on Bowsher’s speech. 
Reporter Mort Mintz calls to discuss 
the specifics of his meeting with 
Walt Sheley next week. | stress that 
discussing anything that borders on 
classified information is out, and he 
agrees. Regrettably, Elizabeth Drew 
doesn’t feel comfortable with the 
narration idea; she feels it could be 
seen as a conflict of interest but 


says she’s flattered that we in- 
quired. | have lunch with Roger 
Sperry, who brings me up to date on 
his new project on administrative 
management across Government. 
He’s enthusiastic about its poten- 
tial in GAO, and | think he has good 
reason to be. He also volunteers to 
contribute to Bowsher’s speech 
drafts—particularly when public ad- 
ministration and management are 
the themes. There’s an opportunity 
for this involvement in a speech Mr. 
Bowsher will give at a meeting of 
the Federal Executive Institute 
alumni group in February. 

After lunch | get transportation 
details worked out for the weekend. 
I’m going away with some very old 
and dear friends. They will pick me 
up at 6 p.m. | finish the draft for the 
GAO Review which | hope will meet 
Hannah’s requirements. (The only 
people | know who don’t mind being 
edited are editors!) | decide not to 
mail my letter to the New York 
Times and head for home. 


GAO Review/Spring 1982 





Judith Hatter 


GAO Review/Spring 1982 


Legislative 


Developments 


The Role of GAO 


Missouri Senator Thomas Eagle- 
ton had the following comments 
about GAO and the role of the 
Comptroller General during Senate 
debate on the nomination of 
Charles A. Bowsher to be Comp- 
troller General of the United States: 


***few positions in the Federal Gov- 
ernment carry more responsibility, 
authority, and potential for valuable 
public service than the position of 
Comptroller General of the United 
States. As head of the General Ac- 
counting Office, the ‘congressional 
watchdog,’ the Comptroller General 
represents our main vehicle for con- 
ducting oversight of the far-ranging 
activities of the Federal Govern- 
ment. If the responsibilities for 
legislative oversight were limited to 
the committees of Congress, the 
result would be woefully inadequate. 

Congress simply lacks the time 
and resources to handle its over- 
sight responsibilities alone. Over 
the years, the professional and im- 
partial GAO reports have saved the 
taxpayers countless billions of 
dollars, and if Congress and execu- 
tive agencies had followed GAO’s 
advice in a timely way, | expect 
billions more could have been 
saved.***' 


Title 31 Revision 


On October 19, 1981, a bill of sig- 
nificance to GAO was introduced by 
Congressman Peter Rodino. H.R. 
4774 would revise, codify, and enact 
laws relating to money and finance, 
as Title 31, United States Code, 
“Money and Finance.” This title 
contains legislation relating to 
GAO's functions and jurisdiction. 


Program Fraud Civil 
Penalties Act of 1981 


On October 27, Senator William V. 
Roth, Jr., introduced, for himself 
and others, S. 1780, the Program 





Fraud Civil Penalties Act of 1981. 
The legislation is ‘“***designed to 
create an administrative mechanism 
that will allow the affected agency 
to impose a monetary penalty for 
fraud.***’? it results from recom- 
mendations contained in a May 7, 
1981, GAO report entitled, “Fraud in 
Government Programs—How Expen- 
sive Is It—How Can It Be Con- 
trolled?”’. 


Department of 
Defense 
Authorization Act, 
1982 


The conferees on the Department 
of Defense Authorization Act, 1982, 
agreed to a provision requiring two 
reports to Congress by the Secre- 
tary of Defense recommending im- 
provements in management effi- 
ciency and elimination of waste, 
fraud, abuse, and mismanagement 
in the operations of the Department 
of Defense. 

The Secretary of Defense must 
set forth in these reports each rec- 
ommendation by the Comptroller 
General on the subject. 


Federal Reserve 
Amendments of 1981 


Florida Senator Paula Hawkins in- 
troduced S. 1691, the Federal 
Reserve Amendments of 1981, to 
subject the Federal Reserve System 
to the annual congressional authori- 
zation and appropriation process. It 
would also restructure the Federal 
Reserve Board and require the Com- 
ptroller General to make at least one 
annual audit of the Federal Reserve 
Board, all Federal Reserve banks, 
and their branches and facilities. 

Senator Hawkins states, ‘“***It is 
only reasonable that our central 
bank, which has so much power 
over the economy, be reviewed at 
least once a year.***’’? 
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Legislative Developments 


CAB Deregulation 


On November 23, California Con- 
gressman Norman Y. Mineta in- 
troduced H.R. 5103, to “accelerate 
both the transition of the airline in- 
dustry toward economic deregula- 
tion and the sunset of the Civil Aero- 
nautics Board.” In commenting on 
the legislation, Congressman Mineta 
indicated that industry performance 
has been monitored through numer- 
ous hearings and through periodic 
studies by GAO. ‘‘***Looking at this 
industry’s total costs over the first 3 
years of deregulation (1978 through 
1980), GAO found that the above fac- 
tors (external economic conditions, 


economic recession, and high in- 
terest rates) pushed total airline 
costs up an incredible 60 percent, 
yet under the beginnings of deregu- 
lation air fares were held to an aver- 
age increase of only 37 percent.* **’4 


National Bridge 
Improvement Act of 
1981 


The National Bridge Improvement 
Act of 1981, S. 1649, would improve 
the Federal program for bridge 
repair and replacement. According 
to its sponsor, Tennessee Senator 
Jim Sasser, the legislation is based 


on a recently released GAO study 
which reviewed the national. bridge 
inspection and highway bridge 
rehabilitation programs for their ef- 
fectiveness. 


In discussing the legislation, 
Senator Sasser stated: “The GAO 
report concludes that current infor- 
mation about bridge conditions is 
inadequate, and that current pro- 
cedures and standards necessary to 
allocate funds to those bridges 
most in need of attention do not 
exist. The GAO report stressed the 
importance of bringing about full 
compliance with bridge inspection 
standards and timetables.***’’ 





‘Cong. Rec., Vol. 127 (Sept. 29, 1981), p. 
S10669-70. 

2Cong. Rec., Vol. 127 (Oct. 27, 1981), p. 
$12227. 

8Cong. Rec., Vol. 127 (Oct. 1, 1981), p. 
$10994. 

‘Cong. Rec., Vol. 127 (Nov. 23, 1981), p. 
E5547. 

5Cong. Rec., Vol. 127 (Sept. 22, 1981), p. 
$10262. 
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Reflections 


Since the Staff Bulletin stopped 
appearing in March 1960 and the 
GAO Review was not published until 
the winter of 1966, here are several 
interesting items taken from the 
1962 spring issues of the Watchdog. 
Twenty years ago: 

e The annual CPA dinner was held 
on May 23 at the U.S. Naval 
Weapons Plant honoring the suc- 
cessful GAO candidates in the May 
and November 1961 CPA examina- 
tion. Among those honored were 
Elliott H. Bushlow, Stephen S. 
Langley, Ill, Fred D. Layton, Ronald 
R. Lee, Christopher H. Loesch, Jr., 
Ronald H. Miller, Hubert A. Neely, 
John F. Simonette, Morton L. Solo- 
mon, James N. Stafford, Jr., Rober- 
son E. Sullins, Donald B. Sutton, 
Sidney Wolin, and Richard J. 
Woods. 

e The first GS-7 Training Program 
for 1962 was given by the Office of 
Staff Management in Washington, 
April 2 through 13. Among the at- 
tendees were Robert F. Hughes, Bill 
W. Thurman, Morton A. Myers, Ray- 
mond E. Hiel, Bert H. Rosen, E. R. 
Wichmann, William J. Anderson, 
John L. Anderson, and Richard A. 
Sheldon. 


Ten years ago, in the spring 1972 
issue of the GAO Review and spring 
editions of the Watchdog you will 
find that: 

e Legislation enacted: Public Law 
92-316, June 22, 1972, 86 Stat. 227, 
amended the Rail Passenger Serv- 
ice Act of 1970 to provide financial 
assistance to the National Railroad 
Passenger Corporation. To audit the 
financial transactions of the Cor- 
poration, the Comptroller General 
was provided access to the records 
of any railroad with which the Cor- 
poration had entered into a contract 
for the performance of intercity rail 
passenger service if the records per- 
tained to the railroad’s financial 
transactions and were necessary to 
facilitate the audit. The Comptroller 
General’s representatives were to 
be afforded full facilities for verify- 
ing transactions with the balances 
or securities held by depositories, 
fiscal agents, or custodians. 

e The Federal Election Campaign 
Act of 1971 was signed into law by 
President Nixon on February 7, 1972, 





and became effective on April 7, 
1972. It required GAO to prescribe 
regulations for implementing title |, 
which provided spending !imitations 
for the use of communications media 
by or on behalf of candidates for 
Federal elective office. “Commu- 
nications media” was defined as 
meaning broadcasting stations, 
newspapers, magazines, outdoor 
advertising facilities, and certain 
uses of telephones. The act also re- 
quired GAO to serve as a national 
clearinghouse for information on 
the administration of elections, in- 
cluding the award of contracts for 
special studies. Title Ill of the act 
was concerned with disclosure of 
Federal campaign funds. 

e Frank C. Conahan, director, Inter- 
national Division, was designated 
an associate director of that divi- 
sion on April 3. 





GAO Staff Changes 


Susan B. Burtner 


Susan B. Burtner was selected for 
the position of deputy director, Gen- 
eral Services and Controller. 

Ms. Burtner joined GAO in 1973 as 
chief of the Reference Section in the 
former Office of Librarian, where 
she was promoted to director. In 
1980, she was promoted to director, 
Office of Information Systems and 
Services. Since March 1981, Ms. 
Burtner has served in the Office of 
the Director, General Services and 
Controller, managing information 
systems development. Prior to join- 
ing GAO, she was employed at the 
Department of Commerce, the De- 
partment of the Air Force, and the 
former Department of Health, Edu- 
cation, and Welfare. 

Ms. Burtner received a B.A. 
degree from Purdue University in 
1964, an M.S. degree in library and 
information science from the Uni- 
versity of Illinois in 1967, and an 
M.A. degree in social and organiza- 
tional behavior from George Wash- 
ington Univeristy in 1979. She is a 
member of the American Society for 
Information Science and Special 
Library Association. Ms. Burtner 
received a Division Director’s Award 
in 1977. 





Johnny C. Finch 


Johnny C. Finch was selected for 
the position of associate director in 
the General Government Division. 
He is responsible for directing and 
managing GAO functions in the tax 
administration issue area. 

Since 1975, Mr. Finch’ has 
served in the General Government 
Division as a supervisory GAO audi- 
tor and supervisory GAO evaluator. 
His most recent assignment was as 
senior group director of the IRS 
audit site. 

As a magna cum laude graduate 
of Florence State College in 1966, 
Mr. Finch received a B.S. degree in 
accounting. He was also a member 
of the Honor Society, an honorary 
member of the Alpha Chi account- 
ing fraternity, and is a member of 
Phi Kappa Phi, the National Honor 
Society. In 1977, Mr. Finch received 
an M.S. degree in governmental ad- 
ministration from George Washing- 
ton University. 

In addition to a Superior Perfor- 
mance Award in 1968, Mr. Finch re- 
ceived a Career Development Award 
in 1973 and a Certificate of Merit in 
1978. In 1973, he was designated a 
certified internal auditor by the In- 
stitute of Internal Auditors. Mr. Finch 
is a member of the Association of 
Government Accountants, the 
American Accounting Association, 
the Midwestern Business Adminis- 
tration Association, and the Institute 
of Internal Auditors. 


Richard W. Gutmann 


Richard W. Gutmann, director, 
Defense Programs Planning and 
Analysis Staff, retired from GAO on 
October 16, 1981. 

Mr. Gutmann had spent about 4 
years in banking, 3 years in the 
Navy, and about 4 years in public ac- 
counting before joining GAO in 
1954. Most of his work in GAO has 
been on activities of the Department 
of Defense in various foreign coun- 
tries as well as in many major cities 
and military installations in the con- 
tinental United States. 

Mr. Gutmann attended the Harvard 
Advanced Management Program 
and various courses offered by the 
Civil Service Commission. During 
his 27-year career with GAO, he 
received numerous awards for his 
outstanding performance. 
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Clerio P. Pin 


Clerio P. Pin, Assistant Comp- 
troller General for Administration, 
left GAO in February 1982 to take 
the post of controller at the United 
States Synthetic Fuels Corporation. 

Mr. Pin first joined the GAO staff 
in 1951. In 1968, he accepted a posi- 
tion with the Atomic Energy Com- 
mission but returned to GAO in 1971 
as director of the Organization and 
Management Planning Staff. Mr. Pin 
also served as director, Office of Ad- 
ministrative Planning and Services; 
Deputy Assistant Comptroller Gen- 
eral for Management Services; direc- 
tor, Management Services; and As- 
sistant to the Comptroller General. 

Mr. Pin served with the Navy dur- 
ing World War Il. He received a B.S. 
degree in accounting from the Uni- 
versity of Scranton in 1951 and com- 
pleted the Advanced Management 
Program at the Harvard Business 
School in 1965. Mr. Pin received 
GAO’s Meritorious Service emblem, 
letters of commendation, the Distin- 
guished Service Award, and a 
Comptroller General’s Group Award 
during his years at GAO. 
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Daniel C. White 


Daniel C. White has been se- 
lected for the position of associate 
director in the Energy and Minerals 
Division with responsibility for mat- 
ters relating to the nuclear energy, 
electric power, and DOE manage- 
ment and administration issue area. 

Mr. White began his career with 
GAO in 1961 as an accountant in the 
Dallas regional office. In 1974, he 
was promoted to assistant regional 
manager in the Chicago regional of- 
fice. He joined the Community and 
Economic Development in Washing- 
ton, D.C., as a supervisory GAO 
evaluator in 1979. Mr. White was 
recently selected to participate in 
GAO’s Executive Candidate Devel- 
opment Program. 

Mr. White received a B.S.B.A. 
from the University of Arkansas in 
1961 and was a member of Beta 
Alpha Psi, an honorary accounting 
fraternity. He is a CPA and a mem- 
ber of the American Institute of Cer- 
tified Public Accountants and the 
Texas Society of CPAs. He received 
a Career Development Award in 
1973, Certificates of Merit in 1977 
and 1979, and Division Director’s 
and Distinguished Service Awards 
in 1981. 
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Other Staff Changes 


NEW DIRECTOR 


Office of Administrative and Publishing Services 
Julius S. Brown 





NEW FINANCIAL MANAGEMENT ADVISOR 


Joint Financial Improvement Program 
Kenneth M. Winne 


NEW SENIOR ATTORNEY-ADVISER 
Office of General Counsel 

Alan Belkin 

Douglas A. Faulkner 

Victor B. Goddard 
REASSIGNMENTS 


Field Operations Division 
David Gray 


RETIREMENTS 


Bush, Meriam Personnel Clerk Accounting and Financial Management Division 


Condore, Maureen S. Secretary Energy and Minerals Division 

Hadley, Eleanor M. Supervisory Evaluator International Division 

Higgins, S. Geneva Secretary Accounting and Financial Management Division 
Hillsinger, Irene B. Secretary International Division 

Shovlin, James Evaluator Human Resources Division 

Stillway, Norma Administrative Officer FOD-San Francisco 

Tayman, Joseph W. Computer Specialist Accounting and Financial Management Division 
Thompson, H. Carroll, Jr. Evaluator Procurement, Logistics and Readiness Division 
Tucker, Richard Supervisory Evaluator Procurement, Logistics and Readiness Division 


Ta the Winter issue (Vol. 17, Issue 1), Mr. John Kingery should have been listed as retiring from FOD-Los 
Angeles, not San Francisco. We apologize for the error. 
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New Staff Members 





The following new staff members reported for work during the period September 21, 1981, through Decem- 


ber 13, 1981. 


Office of the 
Comptroller 
General 


Office of the 


General Counsel 


Office of 
Security & Safety 


Energy and 
Minerals Division 


Federal Personnel 
and Compensation 
Division 


Field Operations 
Division 


General Govern- 
ment Division 


Institute for 


Program Evaluation 


International 
Division 


Bowsher, Charles A. 
Horvat, Helene B. 
Smoot, Debra A. 


Apperson, Norman M., Jr. 


Ham, Brenda F. 
Joseph, Barbara 


Markland, Brenda W. 
Morrow, Charles 
Powell, Linda A. 


Ward, Tanya D. 
Woods, William T. 


Cornelius, William 


Harris, Sandra A. 


Burt, Ernestine B. 
Garrison, Howard H. 
White, Clara G. 
Grimes, Aundrea A. 


Harper, Joyce 
Williams, Betty J. 


Alley, Patricia 


Hancock, Gwendolyn L. 
Tynan, Carol M. 


REGIONAL OFFICES 


Chicago 
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Ellis, Shirley 
Karls, Kristi L. 


Arthur Andersen & Co. 

Arthur Andersen & Co. 

National Credit Union 
Administration 


Dept. of Treasury 
Dept. of Treasury 
Massachusetts Superior 
Court 
Navy Medical Research Institute 
Howard University 
Hastings College 
Dept. of Interior 
Legum, Cochran, Chartrand & 
Wyatt, P.A. 


U.S. Army Criminal 
Investigation Command 


Dept. of Interior 

Community Services 
Administration 

U.S. Commission on Civil Rights 

General Electric Co. 

Dept. of Commerce 

U.S. Park Police 

Associated Minority 
Contractors of America 

Dept. of Education 


Bonneville Power Administration 
Goldstein, Edwards & Betz 


Dept. of Energy 
Health Care Service Corp. 





New Staff Members 


Los Angeles 


New York 


Norfolk 


Philadelphia 


St. Louis 


Washington 


Linden, Gregory S. 
Moore, Teri A. 


Robinson, Gertrude 


Cossu, Sandra A. 


Deraimondo, John B. 


Dolak, Mirko J. 


Edwards, Barry L. 
Garbett, John M. 
Hagerty, Mary R. 
Jacobs-Robinson, 
Debbra L. 
Kiely, Sharon 
Miller, John M. 
Roberts, Allan 
Roitz, Jean M. 
Schneider, Nancy F. 
Seidman, Julie R. 
Tiscareno, Roman J. 


Freeling, Harvey 


Komuves, Joan M. 
Ross, Joyce D. 


Caufield, Faith 
Trice, Marsha A. 


Zurliene, Karen A. 


Eskew, Cheryl-Anne 


Richard D. Jaffe & Associates 
Social Security 
Administration 


Office of Personnel Management 


Equal Employment Opportunity 
Commission 

Office of Auditor General, 
Illinois 

Mathematica Policy Research, 
Inc. 

Alcohol, Tobacco & Firearms 

Office of Presidential Personnel 

Nash & Co. 

National Credit Union 
Administration 

IRS 

IRS 

Hedberg Mfg. and Chemical Co. 

City of Beverly Hills 

State Board of Equalization 

City of Los Angeles 

U.S. District Court 


GSA 

Defense Investigative Service 

Equal Employment Opportunity 
Center 

Cardiac Data Corp., Inc. 

Community Services 
Administration 


Headquarters, Military Airlift 
Command 


Dept. of Commerce 
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Professional Activities 


Office of the 
Comptroller General 


Since taking office in October 
1981, Comptroller General Charles A. 
Bowsher has addressed the follow- 
ing groups: 


Association of Government Ac- 
countants, “Raising Financial 
Management Standards,” Wash- 
ington, Nov. 5. 


National Contract Management 
Association East Coast National 
Symposium, “Reforms in Federal 
Procurement: The GAO Perspec- 
tive,” Washington, Nov. 5. 


“American Association of Budget 
and Program Analysts’ Fall Sym- 
posium, ‘Budgeting, Accounting, 
Program Analysis and Auditing: 
Roles and Relationships for the 
1980’s and Beyond,” Washington, 
Nov. 20. 


American Society for Public Ad- 
ministration, National Capital 
Area Chapter, ‘‘Federal Manage- 
ment Issues and the GAO,” Wash- 
ington, Dec. 3. 


Federal Executive Institute Alum- 
ni Association, ‘The Challenge of 
Change for Public Management,” 
Washington, Feb. 25. 


Joint Meeting of the National As- 
sociation of Accountants and the 
Association of Government Ac- 
countants, ‘Promoting Sound Fi- 
nancial Management in the Fed- 
eral Government,” Roanoke, VA, 
Mar. 17. 


American Society of Military 
Comptrollers, Washington, Mar. 
22. 


National Association of State 
Comptrollers, Washington, Mar. 
30. 


Harry S. Havens, Assistant Comp- 
troller General for Program Evalu- 
ation: 


Participated in the American 
Association for Budget & Pro- 
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gram Analysis’ Fall Symposium, 
“Making Government Manage- 
ment Work Better.” His workshop 
topic was “Micromanagement in 
the Federal Government.” Wash- 
ington, Nov. 20. 


Spoke at the Third Annual Senior 
Financial Management Seminar, 
U.S. Department of Agriculture 
Graduate School, on “Oversight,” 
Washington, Nov. 23. 


Office of the General 
Counsel 


Harry R. Van Cleve, acting general 
counsel, spoke on “Opinions of the 
Comptroller General’ before a 
seminar of all new Reagan Ad- 
ministration general counsels, in 
Reston, VA, Oct. 29. 


Rollee H. Efros, associate general 
counsel, spoke on “Funding of Fed- 
eral Government Activities: Over- 
view of Appropriations Process” to 
participants in a Federal Bar 
Association continuing legal educa- 
tion course on Federal Government 
practice, Dec. 2. 


Ronald Berger, assistant general 
counsel, spoke on “Bid Protests and 
ADP Procurements” before the Fed- 
eral Computer Conference, Sept. 23. 


Ronald Wartow, deputy assistant 
general counsel, addressed the 
American Bar Association Public 
Contract Law Section Seminar on 
“Subcontracting Under a Govern- 
ment Contract,” in Fort Lauderdale, 
Nov. 7. 


Michael J. Boyle, senior attorney, 
spoke before a seminar on ‘“Con- 
tracting with the Government: Re- 
cent Initiatives and Current Prob- 
lems,” sponsored by Coopers and 
Lybrand, in Boston, Oct. 26. 


Richard Cambosos, senior at- 
torney, participated in the Con- 
ference on Interagency Task Force 
Indemnification, sponsored by the 
Office of Management and Budget, 
Nov. 23. 





Stanley G. Feinstein, senior at- 
torney: 


Participated in the Conference on 
“Ground Water in the 80’s,” in 
Chicago, Nov. 11-13. 


Participated in the Seminar Work- 
shop on “Intergovernmental Ad- 
ministration and Grants Manage- 
ment,” Nov. 16-20. 


James H. Roberts, Ill, attorney- 
adviser, spoke before the Defense 
Advanced Procurement Manage- 
ment Course on “Problems in For- 
mal Advertising,” Fort Lee, VA, 
Sept. 23. 


Personnel 


Patricia A. Moore, deputy director 
for operations, will serve as a mem- 
ber of the International Personnel 
Management Association’s 1982 
Awards Committee. The Awards 
Committee has a charge to solicit 
and evaluate the nominations for 
Honorary Life Membership and the 
Warner W. Stockberger Achieve- 
ment Award. 


Nancy E. Weiss, personnel man- 
agement specialist, was elected 
secretary for the Washington, D.C., 
chapter of the International Person- 
nel Management Association for 
1981-1982. She also serves as chair 
of the chapter’s Program Committee. 


Accounting and 
Financial Management 
Division 


Wilbur D. Campbell, acting direc- 
tor, participated in a seminar on 
governmental auditing, sponsored 
by the Mexican Government, Mexico 
City, Oct. 4-8. 


Walter L. Anderson, senior 
associate director, organized and 
chaired a panel on Resources Ac- 
counting at the Federal Computer 
Conference, in Washington, Sept. 
23. 


George L. Egan, associate direc- 
tor: 
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Professional Activities 


Spoke on the “Role in Inspector 
General Legislation” before the 
Inspector General—State Depart- 
ment, in Washington, Sept. 8. 


Spoke on “The Present and the 
Future in Government” before a 
meeting with the Western Inter- 
governmental Audit Forum and 
the Association of Government 
Accountants, in Honolulu, Sept. 
23-24. 


Participated in the International 
Seminar on Governmental Audit- 
ing, in Mexico City, Oct. 4-9. 


Attended the Interagency Auditor 
Training Programs meeting at the 
Graduate School, U.S. Depart- 
ment of Agriculture, in Washing- 
ton, Nov. 6. 


Spoke on “Internal Auditing and 
Fraud Prevention’ before the 
Mountain and Plains Intergovern- 
mental Audit Forum, at Colorado 
Springs, Nov. 12-13. 


Spoke on “How Much Control Is 
Adequate?” at the Vulnerability 
Study and Risk Analysis Work- 
shop sponsored by the Federal 
Audit Executive Council and the 
Joint Financial Management Im- 
provement Program, in Washing- 
ton, Nov. 19. 


Ronald J. Points, associate direc- 
tor: 


Spoke on “GAO’s Audit Stan- 
dards—The ‘Yellow Book’” at the 
94th Annual Meeting of the Ameri- 
can Institute of Certified Public 
Accountants, Chicago, Oct. 6. 


Spoke on “The Governmental Ac- 
counting Standards Board” at the 
Pittsburgh AGA Chapter, in Pitts- 
burgh, Oct. 28. 


Virginia B. Robinson, associate 
director, spoke on “What Have 
Automated Financial Management In- 
formation Systems Done to Our Man- 
agers, What Have Our Managers 
Done to Automated Financial Man- 
agement Information Systems?” at 
the National Institute of Manage- 
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ment Research Conference, Wash- 
ington, Dec. 10. 


Brian L. Usilaner, associate direc- 
tor: 


Spoke on “Can Quality Circles Be 
Useful on the Public Sector?” toa 
top management group in the 
D.C. Government, Sept. 17. 


Spoke on “Prospects in Produc- 
tivity Sharing in the Public 
Sector’ at the American Institute 
of Industrial Engineers Con- 
ference, Philadelphia, Oct. 14. 


John F. Simonette, associate 
director: 


Spoke on “Debt Collection and In- 
ternal Controls” at the Second 
Annual Conference of the Finan- 
cial Council of the Department of 
Agriculture on Financial Manage- 
ment Improvement, Fort Myer, VA, 
Sept. 23. He also participated, 
along with Jeff Steinhoff, senior 
group director, and Jerry F. 
Wilburn, credit and collection 
systems analyst, in a workshop 
on debt collection. 


Participated in a workshop at the 
National Intergovernmental Audit 
Forum on Debt Collection, Wash- 
ington, Nov. 5. 


Spoke before the Detroit Chapter 
of the Institute of Internal Audi- 
tors—November Seminar, on 
GAO’s work in assessing the im- 
pact of the Foreign Corrupt Prac- 
tices Act on U.S. business, Nov. 
10. 


Joseph L. Boyd, senior group 
director, spoke on “Internal Con- 
trols in Computer-Based Systems’”’ 
before a meeting of Minnesota 
legislative auditors in St. Paul, 
Sept. 21. 


Joseph J. Donlon, senior group 
director: 


Spoke on “GAO Accounting Sys- 
tem Approval Process” at the De- 
partment of Agriculture’s Gradu- 
ate School Seminar on Financial 


Management, Washington, Nov. 
4. 


Spoke on “Accounting Systems, 
Internal Controls, and the Internal 
Auditor” at the First Army Comp- 
trollers’ Conference, Fort Meade, 
MD, Nov. 8. 


Ken Pollock, group director: 


Addressed the National Capital 
Area Chapter of the EDP Auditors 
Association on GAO’s recent re- 
port, ‘‘Federal Agencies Still 
Need To Develop Greater Compu- 
ter Audit Capabilities” (AFMD- 
82-7, Oct. 16, 1982), in Washing- 
ton, Oct. 20. 


Spoke at the 8th Annual Cor- 
ference on Computer Security on 
GAO’s report on computer disas- 
ter planning in the Federal Gov- 
ernment, in New York City, Nov. 
10. 


Was invited to the Canadian Insti- 
tute of Chartered Accountants’ 
Symposium on Computers and 
Auditing, in Toronto, Nov. 15-18. 


Carl R. Palmer, group director: 


Chaired a panel on ‘Change at 
DOD Life Cycle Management And 
Planning” at the Federal Com- 
puter Conference in Washington, 
Sept. 22. 


Spoke on ‘Misuse of SBA’s 8(a) 
Program Increased Cost for Many 
ADP Equipment Acquisitions,” 
along with GSA and SBA repre- 
sentatives, at the Interagency 
Committee on ADP, in Washing- 
ton, Oct. 13. 


Chaired the 1981 Conference of 
the Computer Performance Evalu- 
ation Users Group and its keynote 
panel on “Increasing Organiza- 
tional Productivity” in San An- 
tonio, Nov. 16-19. 


Jerry F. Wilburn, credit and collec- 
tion systems analyst, spoke at an 
Office of Management and Budget 
private-sector collection agency 
symposium, in Washington, Nov. 20. 
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J. Chris Farley, management ana- 
lyst, discussed pending legislation 
affecting debt collection, before a 
joint military debt collection work- 
shop in Indianapolis, Sept. 22. 


Michael O. Baskin, acting chief, 
Debt Branch, participated in a joint 
military debt collection workshop in 
Indianapolis, Sept. 22. 


Darrell L. Heim, ADP assignment 
manager, spoke on ‘Computer 
Fraud Prevention and Safeguards” 
during a seminar on Management of 
White Collar Crime Investigations, 
hosted by the Association of Fed- 
eral Investigators, in Rosslyn, VA, 
Sept. 22. 


Joseph Comtois, senior evalu- 
ator: 


Spoke before the State Depart- 
ment Inspector General regarding 
“Standards for Audit of Govern- 
mental Organizations, Programs, 
Activities, and Functions,” Sept. 
8. 


Participated in discussion with 
the Associated Accounting Firms 
International on the “Single Audit 
Concept,” in Washington, Nov. 
12. 


David A. Dore, supervisory evalu- 
ator, spoke on ‘“Non-Federal Com- 
puter Acquisition Practices Provide 
Useful Information for Streamlining 
Federal Methods” before the Inter- 
agency Committee on Automatic 
Data Processing, in Washington, 
Sept. 8; and at a DOD Tri-Services 
ADP Acquisition Conference at 
Hanscom AFB, MA, Nov. 18. 


Morey J. Chick, evaluator, made a 
presentation on the significance of 
“The Paperwork Reduction Act of 
1980 (P.L. 96-511)” at a conference 
sponsored by the National Institute 
for Management Research, Wash- 
ington, Nov. 19. 


Theodore Gonter, group director, 
chaired individual sessions of a 
panel on “Increasing Organizational 
Productivity” at the 1981 Con- 
ference of the Computer Perfor- 
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mance Evaluation Users Group, in 
San Antonio, Nov. 16-19. 


Dennis Shaw, evaluator, chaired 
individual sessions of a panel on 
“Increasing Organizational Produc- 
tivity” at the 1981 CPEUG Con- 
ference in San Antonio, Nov. 16-19. 


George Sotos, group director, 
spoke on “Risk Assessment—An 
Essential Part of Planning” at the 
Federal Computer Conference, in 
Washington, Sept. 22. 


Joint Financial 
Management 
Improvement Program 


Susumu Uyeda, executive direc- 
tor: 


Gave a presentation on “The new 
Initiatives of the Central Financial 
Management Agencies’ at the 
DOD Information Exchange Pro- 
gram Commanders Conference in 
Denver, Oct. 26. 


Gave a presentation of JFMIP at 
the Financial Managers Con- 
ference of the Federal Prison In- 
dustries, Leesburg, VA, Oct. 26. 


Doris Chew, assistant executive 
director, sponsored with the Federal 
Executive Board a workshop on Im- 
proving Productivity in Accounting 
and Finance Operations and gave a 
presentation on the Productivity 
Measurement System at the Depart- 
ment of Commerce, in Atlanta, Sept. 
25. 


Ken Winne, senior project direc- 
tor, spoke to the Mountain and 
Plains Intergovernmental Audit 
Forum on “The Federal Assistance 
Award Data System Study,” in Col- 
orado Springs, Nov. 12-13. 


Community and 
Economic 
Development Division 


Roy Kirk, group director, was in- 
terviewed by Jeff Lubar of Sus- 
quehanna Broadcasting on Federal 


Professional Activitics 


land acquisitions in the Cuyahoga 
Valley Recreation Area, for broad- 
cast in northeast Ohio. The inter- 
view was based on GAO’s report, 
“Federal Land Acquisition and Man- 
agement Practices” (CED-81-135, 
Sept. 11, 1981). 


Skip Jenkins, evaluator, dis- 
cussed GAO’s report, ‘‘More Can be 
Done To Protect Depositors at Fed- 
erally examined Grain Warehouses” 
(CED-81-112, June 19, 1981) before 
the Association of American Ware- 
house Control Officials, in St. Louis, 
Sept. 22. 


Margaret Goodman and Walter 
Hess, evaluators, discussed 
“Assessing Personnel needs in the 
Agricultural Sciences” before the 
National Research Council of the 
National Academy of Sciences, 
Sept. 22. 


Dennis Parker and Ken Good- 
miller, evaluators, discussed GAO’s 
1980 studies on highway safety pro- 
grams at the annual conference of 
the National Association of Gover- 
nors’ Highway Safety Represen- 
tatives, Hershey, PA, Oct. 14. 


Walter Hess, evaluator, spoke on 
“The Cooperative Extension Serv- 
ice: A GAO Overview” before the 
State Agriculture and Natural Re- 
sources Program Leaders in Wash- 
ington, Oct. 20. 


Manohar Singh, evaluator, has 
written the following articles: 


“Why Not Use Fischer-Troph?” in 
Hydrocarbon Processing, June 
1981. 


“Major Technical Risks of Solvent 
Refined Coal-l and -ll Demonstra- 
tion Projects” in Proceedings of 
the Synfuel First Worldwide Sym- 
posium, Brussels, Belgium, Oct. 
1981. 


Roy Kirk, group director, and Bill 
Dunahay, evaluator, discussed 
GAO’s reports on Indian programs 
at a symposium for Indian educa- 
tors, in Washington, Oct. 29. 
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Federal Personnel and 
Compensation Division 


Kenneth J. Coffey, associate 
director, spoke before the following 
groups: 


Defense Systems Management 
College on ‘“‘GAO’s Perspective of 
DOD Manpower Management,” 
Sept. 17. 


Local Regional Conference of the 
American Society of Personnel 
Administration on “The Future of 
U.S. National Defense Strategy: 
Manpower versus Technology,” 
Oct. 5. 


Joseph J. Kline, group director, 
spoke before the Third Annual Con- 
ference of Training Directors at the 
University of Maryland on ‘“'GAO’s 
Work in Training: Current Status 
and Future Directions,” Oct. 26. 


Energy and Minerals 
Division 


Don Forcier, senior group direc- 
tor, under the sponsorship of the 
Brookings Institution, spent several 
weeks in Europe meeting with repre- 
sentatives of government and in- 
dustry on energy policy and national 
security. Mr. Forcier met with of- 
ficials in London, Brussels, Paris, 
Bonn, and Vienna, in December. 


General Government 
Division 


William J. Anderson, director, and 
Willis Elmore, group director, par- 
ticipated in a panel discussion on 
the performance of the U.S. Postal 
Service, at the National Academy of 
Public Administration, Nov. 23. 


Richard B. Groskin, issue area 
planner for the law enforcement and 
administration of justice issue area: 


Was elected to the Executive 
Board of the American Society for 
Public Administration—SCJA, 
Apr. 1981. 


Was appointed to the Executive 
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Council on National Policy for 
Justice Administration, American 
Society of Criminology, June 
1981. 


Larry Harrell, senior evaluator, 
and Jeff Bernstein, evaluator, 
discussed detention and separation 
practices in State and Federal agen- 
cies before the National Coor- 
dinating Council on Juvenile Justice 
and Delinquency Prevention, Wash- 
ington, Sept. 30. 


Arthur Goldbeck, associate direc- 
tor, and Robert Hart, group director, 
discussed GAO’s reports ‘‘The Fed- 
eral Structure for Examining Finan- 
cial Institutions Can Be Improved” 
and “Federal Examinations of Fi- 
nancial Institutions: Issues That 
need To Be Resolved” before the 
Associated Accounting firms Inter- 
national, in Washington, Sept. 22. 


Linda L. Harmon, evaluator: 


Was elected to a 2-year term asa 
National Director of the Mont- 
gomery-Prince Georges chapter 
of the National Association of Ac- 
countants. 


Was recently elected the Prin- 
cipal of the Potomac & Chesa- 
peake Council, National Associa- 
tion of Accountants. 


Paul Posner, supervisory evalu- 
ator: 


Was appointed to the Board of 
Directors, National Assistance 
Management Association, Sep- 
tember. 


Spoke at the annual meeting of 
the National Emergency Manage- 
ment Association on GAO’s 
review of emergency manage- 
ment grant consolidation, in 
Nashville, Sept. 24. 


Delivered a paper, ‘Separating 
Money From Administration in In- 
tergovernmental Programs” to 
the annual conference of the 
American Association for Public 
Policy Analysis and Management, 
Oct. 24. 


Human Resources 
Division 


Pete McGough, associate di- 
rector, discussed GAO’s role in 
identifying Social Security policy 
changes set forth in the Omnibus 
Budget Reconciliation Act of 
1981, before the American Associ- 
ation for Budget and Program 
Analysis, Washington, Nov. 12. 


Bill Gadsby, group director, 
discussed GAO’s role in evalu- 
ating health personnel programs, 
before the American Hospital 
Association’s meeting on “Health 
Manpower Issues of the 80’s,” 
Oct. 21. 


Wendy Tupper and Ted Zeunges, 
evaluators, discussed GAO’s review 
of Federal, State, and local efforts 
to combat the problems of teenage 
prostitution and child pornography, 
at the first annual Eastern States 
Vice Investigator’s Conference, in 
Springfield, VA, Nov. 20. 


John W. Lainhart, group director: 


Was elected Treasurer of the EDP 
Auditor’s Association, Inc., for 
1981-1982. 


Spoke on “ADP System Develop- 
ment Life Cycle—Post Implemen- 
tation Audits” at the 9th Interna- 
tional EDP Auditors Association 
Conference, Washington, June 
24. 


Institute for Program 
Evaluation 


Eleanor Chelimsky, director, 
delivered the president’s address, 
“Designing Backward from the End- 
Use” at the Evaluation Research 
Society’s annual meeting in Aus- 
tin, TX, Oct. 1-3. 


Wallace M. Cohen, group direc- 
tor: 


Was the program chair for the 
annual meeting of the Evalua- 
tion Research Society in 
Austin, Oct. 1-3. 
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Chaired a panel on Federal 
evaluation perspectives at the 
national meeting of the Opera- 
tions Research Society and the 
Institute of Management Sci- 
ences in Houston, Oct. 12. 


Laurie Ekstrand, statistician, pre- 
sented a paper entitled, “Improving 
Survey Design: Focus Group Inter- 
viewing Randomized Response’”’ at 
the annual meeting of the Southern 
Political Science Association in 
Memphis, Nov. 5-7. 


Terry E. Hedrick, evaluator: 


Chaired a symposium honoring 
four evaluators new to the eval- 
uation research profession, at 
the annual meeting of the Eval- 
uation Research Society, 
Austin, Oct. 1-3. 


Spoke before faculty and grad- 
uate students of the Social Psy- 
chology Research Group, Uni- 
versity of Maryland, on “Roles 
for Social Scientists in Pro- 
gram Evaluation,” Oct. 26. 


Wilfred B. Holloway, social 
science analyst, wrote an article en- 
titled, “Youth Employment/Educa- 
tion Programs: Where Are We Head- 
ed?” for the November 1981 issue of 
Education and Urban Society. 


Liselott Lisle, actuary, spoke on 
“Financial Reports for Federal 
Retirement Systems” at a panel on 
public pension plans, before the 
Conference of Actuaries in Public 
Practice, Phoenix, Oct. 1. 


Irene T. Mann, social science 
analyst, presented a paper entitled, 
“Policy Implications for Nursing 
Home Utilization, Reimbursement, 
and Bed Supply,” written by Janet 
Shikles and Susan Van Gelder of 
IPE, at the annual meeting of the 
Gerontological Society of America 
and Canadian Association on Ger- 
ontology, Toronto, Nov. 9. 


Keith E. Marvin, former associate 
director, as Chairman of the Stan- 
dards Committee of the Evaluation 
Research Society, obtained ap- 
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proval for publication of new evalua- 
tion standards. He was also cochair- 
man of a panel on evaluation stan- 
dards and participated in a panel 
discussion on “Evaluating the Eval- 
uators” at the annual meeting of the 
Evaluation Research Society, 
Austin, Oct. 1-3. 


Garry L. McDaniels, deputy direc- 
tor, delivered a keynote address en- 
titled ‘Needs and Priorities—A 
Forecast” before the Faculty Col- 
lege on Trends and Issues in Educa- 
tional Research, at the University of 
Maryland, Nov. 12. 


Ray C. Rist, supervisory evalu- 
ator: 


Edited a section on ‘Youth 
Education and Employment Train- 
ing: Policy Issues and Options” 
and wrote an article on “Walking 
Through a House of Mirrors: 
Youth Education and Employ- 
ment Training” for the November 
1981 issue of Education and Ur- 
ban Society. 


Published a new book entitled 
Earning and Learning: Youth 
Employment Policies and Pro- 
grams, Sage Publications, Inc., 
1981. 


Published an article entitled 
“Education and Marginality: The 
Guestworkers in Germany,” in /n- 
terchange on Educational Policy, 
Vol. 12, No. 2, 1981. 


Susan Van Gelder, management 
analyst, participated in a panel 
discussion on long-term health 
care, at Catholic University’s Grad- 
uate School of Social Welfare, 
Washington, Oct. 26. 


Carlotta Young, psychologist, 
organized and chaired a panel on 
“The Role of Social Psychology in 
the Policy Process” before the 
Capital Area Social Psychological 
Association, College Park, MD, Oct. 
17. 


International Division 


Harry Finley, associate director, 
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discussed “The GAO Assessment— 
Arms Transfer and Foreign Military 
Sales Problems/Changes” at the 
American Institute of Aeronautics 
and Astronautics’ Conference on In- 
ternational Arms and Technology 
Transfer, Washington, Nov. 5, and 
Boston, Nov. 12. 


Stephen Hachten, William Slot, 
and Allan Hovey, supervisory eval- 
uators, conducted a class session 
of the Mid-Level Officers Profes- 
sional Development Program at the 
State Department’s Foreign Service 
Institute, Nov. 12, on, ID’s report to 
the Congress, “U.S. Consular Ser- 
vices to Innocents—and Others— 
Abroad: A Good Job Could Be Better 
With a Few Changes.” Also, Mr. 
Hovey addressed a class in public 
diplomacy at the American Univer- 
sity School of International Service, 
Dec. 3, on GAO’s work in interna- 
tional communication programs. 
GAO’s 1979 report, “The Public 
Diplomacy of Other Countries: Im- 
plications for the United States,” 
was required reading for the course. 


Mission Analysis and 
Systems Acquisition 
Division 


Walton H. Sheley, Jr., director, 
spoke before the National Institute 
for Management Research Confer- 
ence on “Systems Acquisition and 
Management,” Washington, Dec. 7. 


Donald E. Day, senior associate 
director, spoke before the following 
groups: 


Defense Systems Management 
College Executive Refresher 
Course on “GAO’s Perspectives 
on the DOD Acquisition Process,” 
Fort Belvoir, VA, Sept. 28 and Nov. 
16. 


16th Annual Department of De- 
fense Cost Analysis Symposium 
on “Cost Growth and Contain- 
ment,” Washington, Oct. 5. 


Navy Systems Acquisition Man- 
agement Schoo! on “GAO Activ- 
ities on Major Weapon System 
Work,” Washington, Oct. 30. 
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Warren G. Reed, senior associate 
director, received the Defense De- 
partment’s Meritorious Civilian Serv- 
ice Medal for his ‘“. .. extraordinary 
contributions while serving in criti- 
cal leadership positions in Defense 
from October 28, 1963 to May 1, 
1981” in Washington, Nov. 20. 


Lester C. Farrington, Jr., group 
director, and David G. Sapp, senior 
evaluator, spoke before the Defense 
Systems Management College on 
“GAO’s Role in Test and Evaluation,” 
Fort Belvoir, VA, Oct. 29. 


Stanley LaVallee, operations 
research analyst, participated in a 
panel discussion on “Analytical 
Needs for the Eighties” at the 48th 
Military Operations Research So- 
ciety Symposium in Monterey, CA, 
Dec. 3. 


John L. Anderson, senior evaluator, 
has been elected Secretary of the 
Northern Virginia Chapter of the Na- 
tional Association of Accountants. 


Suzanne Macfarlane, evaluator, 
was a principal writer for volumes III 
and IV of the Dictionary of American 
Naval Fighting Ships, published in 
August by the Navy’s Naval Histori- 
cal Center. 


Office of Information 
Systems and Services 


Phyllis Christenson, chief, law 
library services, conducted a work- 
shop on “Legislative Librarianship” 
for the Federal Interagency Field 
Librarians’ Workshop, Seattle, Nov. 
19. 


Program Analysis 
Division 


Donna Heivilin, supervisory eval- 
uator, discussed GAO’s reviews of 
capital budgeting practices, at the 
National Association of State Bud- 
get Officers’ Capital Budgeting 
Workshop, Kansas City, Oct. 7. 


Howard J. Gobstein, science 
policy analyst, chaired, and Carl T. 
Grafton, science policy analyst, par- 
ticipated in a panel discussion on 
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research instrumentation for univer- 
sities at the sixth annual meeting of 
the Society for Social Studies of 
Science, Atlanta, Nov. 6. 


Kenneth P. Ruscio, evaluator, par- 
ticipated in a panel on organiza- 
tional setting for research at the 
sixth annual meeting of the Society 
for Social Studies of Science, Atlan- 
ta, Nov. 6. 


Charles Bausell, economist, par- 
ticipated in a panel discussion on 
“Environmental Policy” at the third 
annual conference of the Associa- 
tion for Public Policy Analysis and 
Management, Washington, Oct. 23. 


Gwendolyn B. Moore, social 
science policy analyst, addressed 
the Innovation Study Group of the 
Smaller Business Association of 
New England on “Consistent Criteria 
Are Needed To Assess Small Busi- 
ness Innovation Initiatives” (PAD-81- 
15, July 7, 1981), Boston, Dec. 3. 


Natwar M. Gandhi, evaluator, ad- 
dressed the plenary session of the 
third annual Institute on Insurance 
Taxation on “Life Insurance Com- 
pany Income Tax Act of 1959: Analy- 
sis and Recommendations for 
Change” at the University of Hart- 
ford, Oct. 5. 


Arthur J. Corazzini, deputy direc- 
tor, spoke before the Government Pa- 
tent Lawyer’s Association on the im- 
plementation of Public Law 96-517, 
Washington, Oct. 22. 


Kenneth W. Hunter, senior asso- 
ciate director: 


Spoke on “New Directions in the 
Policymaking Process in a Decade 
of Transition” at the Washington 
Operation Research/Management 
Science Symposium, Nov. 2. 


Chaired the Association for 
Budget and Program Analysis’ 
fall symposium and moderated a 
panel discussion responding to 
Comptroller General Bowsher’s 
keynote address on ‘Budgeting, 
Accounting, Program Analysis, 
and Auditing: Roles and Relation- 
ships for the 1980’s and Beyond” 
on Nov. 20. 


Procurement, 
Logistics and 
Readiness Division 


Bob Gilroy, senior associate 
director, spoke on “GAO Perspec- 
tives on Government Procurement” 
at the Federal Bar Association’s 
Western Briefing Conference, Oct. 
27. 


John Rinko, group director: 


Was interviewed by Morley Safer 
of CBS’ 60 Minutes on Julie 
Research Laboratory’s attempts 
to obtain Army contracts for 
calibration equipment, Nov. 6. 


Spoke on audit and investigative 
techniques in uncovering procure- 
ment fraud, at the FBI Academy, 
Quantico, VA, Dec. 2. 


Ron King, senior evaluator: 


Was appointed to the National 
Academy of Sciences’ Advisory 
Board on the Built Environment, 
Committee on the International 
Conference on Computers in 
Building and Construction. 


Participated on a review board for 
the Massachusetts Institute of 
Technology to develop an Archi- 
tectural Science Consistent Sys- 
tem (a computer-aided design 
system), Washington, Oct. 7. 


Ken Brubaker, senior evaluator, 
spoke on “The General Accounting. 
Office’s Interest in Transportation” 
before the Defense Advanced Traf- 
fic Management Course, Fort 
Eustis, VA, Sept. 16. 


Jim Wiggins, evaluator, dis- 
cussed “Procurement Auditing” 
before the Pacific Northwest Inter- 


governmental Audit Forum, Port- 
land, OR, Oct. 15. 


Field Operations 
Division 


Atlanta 


Marvin Colbs, regional manager, 
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spoke on “Carrying Out Oversight 
Function—How GAO Interfaces 
with DOD” to the controller’s course 
of the Air University, Maxwell AFB, 
AL, Nov. 10. 


Pat Patterson, assistant regional 
manager, spoke on “Using the Com- 
puter as an Audit Tool” to the Insti- 
tute of Internal Auditors, Huntsville, 
Nov. 17. 


Boston 


Bob Sayers, senior evaluator, was 
a member of a panel discussion on 
current and proposed government 
regulations, at the annual conven- 
tion of the Association of Indepen- 
dent Medical Equipment Suppliers, 
Washington, Oct. 17. 


Fred Cross, senior evaluator, 
spoke on “EDP Reliability Assess- 
ment” at the 1981 EDP Audit Sym- 
posium sponsored by the Touche, 
Ross Aid to Education Foundation, 
held at the University of Massa- 
chusetts, Amherst, Oct. 20. 


Nick Carbone, assistant regional 
manager: 


Together with Don Benson, eval- 
uator, was a member of a panel 
discussion on GAO’s report ‘“‘Cost- 
ly Wastewater Treatment Plants 
Fail to Perform as Expected,” 
(CED-81-9, Nov. 14, 1980), at the 
annual meeting of the New 
England Water Pollution Control 
Association, Whitefield, NH. 


Spoke on “Using Preliminary Sur- 
veys to Develop Audit Programs” 
at the Greater Boston Chapter, In- 
stitute of Internal Auditors 
seminar on “The Performance of 
Audit Work,” Nov. 11. 


Cincinnati 


Vernon Nieporte, evaluator, spoke 
to the University of Dayton, Delta 


Sigma Pi Professional Business 
Fraternity, on “GAO’s Role in Gov- 
ernment Operations,” Nov. 13. 
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Michael Curro, evaluator, pre- 
pared an article on “The New Block 
Grants: An Initial Post-Mortem” for 
the November issue of the Public 
Administration Newsletter of Xavier 
University. 


Arthur Foreman, evaluator, spoke 
on “How To Implement the Internal 
EDP Audit Function” to the Dayton 
Chapter of the Institute of Internal 
Auditors, Dayton, Nov. 23. 


Ken Libbey, evaluator, organized 
and moderated a panel discussion 
on the subject “Merit Pay in the 
Public Sector—lIs it Working?” for 
the Cincinnati Chapter of the Ameri- 
can Society for Public Administra- 
tion, Nov. 17. 


Dallas 


Francis Langlinais, senior evalua-. 


tor: 


In his role as Regional Vice-Presi- 
dent of the Association of Govern- 
ment Accountants, Southwestern 
Region, spoke on annual Associa- 
tion activities before the Houston 
and Austin chapters, Sept. 24 and 
Oct. 13, respectively. He spoke 
before the San Antonio chapter 
on the topic, “What To Expect 
From an ADP Auditor,” Oct. 20. 


Participated in an item writer’s 
conference for the EDP Auditor’s 
Association, where questions for 
the Certified Information Systems 
Auditor Exam were written and 
evaluated. 


Denver 


Arley R. Whitsell, assistant 
regional manager, spoke before the 
Englewood Lions Club on “The 
History and Functions of GAO,” 
Englewood, CO, Dec. 8. 


John Russo, evaluator: 
Presented GAO’s training course 
“Conducting Program Results Re- 
views” to GSA and DOE auditors 
and analysts, Denver, Nov. 4-6. 


Along with James K. Meissner, 
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evaluator, presented a program 
session entitled “Water, Water 
Everywhere, But No One Wants 
To Drink (Case Study: Operational 
Auditing)” at Emerging Issues 
Conference sponsored by the 
Denver Chapter of the Association 
of Government Accountants and 
the Colorado Fiscal Managers’ 
Association, Denver, Nov. 19. 


Clifford B. Neuroth and Robert L. 
Thames, evaluators, participated in 
a discussion of indirect costs on re- 
search grants, at an Intermountain 
University Research Administrators’ 
meeting, Logan, UT, Nov. 19. 


Phillip D. Sykora, evaluator, par- 
ticipated in a review of the quality 
control system for the California Of- 
fice of the Auditor General, con- 
ducted under the auspices of the 
National Intergovernmental Audit 
Forum and the National State Audi- 
tors’ Association, Sacramento, 
Sept. 13-25. 


Glen L. Baughman, evaluator: 


Is aconsultant to the independent 
Commission of Fiscal Account- 
ability of the Nation’s Energy Re- 
sources, established on July 20, 
1981, by Secretary of the Interior 
James G. Watt and the Reagan 
Administration, to investigate and 
report on the alleged underpay- 
ments of oil and gas royalties due 
to the Federal Government and In- 
dian tribes, and theft of oil from 
their lands. Commission members 
include Elmer B. Staats, former 
Comptroller General. 


Accompanied John F. Simonette, 
associate director, AFMD, in pre- 
senting testimony and participat- 
ing in a panel discussion during 
hearings on the Commission on 
Fiscal Accountability of the Na- 
tion’s Energy Resources, Denver, 
Nov. 20. Also accompanying 
Simonette were Jeff Steinhoff, 
group director, AFMD; Darby 
Smith, senior accountant, AFMD; 
and Ben Ritt, evaluator, WRO. 


Detroit 


William F. Laurie, evaluator, pre- 
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sented a paper entitled ‘Nutrition of 
Older People—A National Perspec- 
tive” at the International Geronto- 
logical Society Meeting of America, 
Toronto, Nov. 10. 


Kansas City 


Larry Van Sickle, evaluator, spoke 
on the background and methodology 
of our recently issued warehouse 
report “More Can Be Done To Protect 
Depositors at Federally Examined 
Grain Warehouses” (CED-81-112, 
June 19, 1981), before the American 
Association of Warehouse Control 
officials, St. Louis, Sept. 22. 


Margarita Ellis, writer/editor, gave 
a poetry reading with themes about 
the Hispanic woman at the 1981 Cul- 
tural Awareness Training Seminar, 
Kansas City, Sept. 17. 


Los Angeles 


Vic Ell, senior evaluator, spoke 
on: 


“Auditing Government Health 
Programs” before GAO’s Inter- 
national Fellows (16 persons from 
developing countries who were 
selected to iearn about GAO 
auditing techniques by their gov- 
ernments), Washington, Oct. 1. 


“Use of Statistical Sampling 
Techniques and Computer Appli- 
cations in GAO Audits” before the 
CSU Los Angeles faculty at their 
annual accounting department 
retreat, Los Angeles, Oct. 10. 


“The Work of the GAO” to a group 
of international students in a USC 
graduate class on theory and 
practice of public administration, 
Los Angeles, Nov. 20. Also ad- 
dressing the group were Jim Hall, 
regional manager, and Nick Rug- 
giero and Jerry Dorris, assistant 
regional managers. 


“Career Opportunities with the 
GAO” before the Beta Alpha Psi 
Accounting Honor Society at 
CSU, Los Angeles, Nov. 24. 
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Fred Gallegos, evaluator: 


Was elected a trustee of the EDP 
Auditors Foundation for educa- 
tion and research, in October. 


Taught an EDP Auditing course at 
California State Polytechnic Uni- 
versity, Pomona, during the Fall 
1981 quarter. 


Had his presentation on “Training 
the ADP Auditor’ published in the 
Fall issue of the EDP Auditors 
Journal. 


Was named project leader and 
developer of the ClIS-13, EDP 
Auditing course in DPMA’s 1980 
collegiate model curriculum for 
information systems. 


Helped organize an Information 
Systems Alumni Association at 
California State Polytechnic Uni- 
versity, Pomona. 


Bob Leshinski, evaluator, was 
selected as an “Outstanding Young. 
Man of America for 1981” in recogni- 
tion of his outstanding professional 
achievement, superior leadership 
ability, and exceptional service to 
the community. 


Norfolk 


Don Ingram, senior evaluator, 
spoke on behalf of the Association 
of Government Accountants at a 
regional convention of the Naval 
Audit Service, Sept. 23. 


Tom Stevenson, senior evaluator, 
recently addressed a gathering 
sponsored by Beta Alpha Psi at the 
University of North Carolina’s 
School of Business Administration. 
His talk, “Careers in Government 
Accounting,” was part of a series of 
seminars at Chapel Hill on account- 
ing careers. 


Paul Latta, evaluator, gave a 
speech on ‘“‘An Overview of GAO” to 
the Chesapeake Rotary Club, 
Chesapeake, VA, Nov. 4. 


Philadelphia 


Frederick P. German, evaluator, 


spoke on “Careers with GAO” 
before the National Association of 
Accountants, Delaware County, 
Pennsylvania, Chapter, Oct. 15. 


William F. Schmanke, technical 
assistant group coordinator, com- 
pleted his term as President of the 
Mid-Atiantic Government Informa- 
tion Council—MAGIC, and was 
elected to serve as 1982 Delegate to 
the National Federation of ADP 
Sharing Councils. Thomas N. 
Bloom, evaluator, was elected Trea- 
surer of MAGIC for 1982. 


San Francisco 


Tim McCormick, regional man- 
ager: 


Participated in a conference for 
business executives on Federal 
Government operations at the 
Brookings Institution, Washing- 
ton, June 29. 


Participated in a forum on Fed- 
eral Productivity and the Quality 
of Working Life, sponsored by the 
Office of Personnel Management, 
McClellan AFB, Oct. 29-30. 


Along with Hal D’Ambrogia, assis- 
tant regional manager, Dave 
Peltier and Jack Birkholz, senior 
evaluators, participated in a meet- 
ing of the Western Intergovern- 
mental Audit Forum in Carson 
City, NV, Nov. 19-20. 


Jim Mansheim, assistant regional 
manager, and John Moran, senior 
evaluator, made a presentation on 
office automation to the Office 
Automation Research Forum, San 
Francisco, Dec. 2. 


Charlie Vincent, assistant regional 
manager, gave a presentation on 
Operational Auditing at the Re- 
gional AGA Seminar, Seattle, Oct. 
29. 


Hal D’Ambrogia, assistant re- 
gional manager: 


Presented a session at the AGA 


emerging issues conference, 
Honolulu, Sept. 23. 
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Received an award for exemplary 
service and dedication, from the 
Western Intergovernmental Audit 
Forum, Nov. 19. 


Elliott Smith, senior evaluator: 


Gave a presentation to the ac- 
counting students on job oppor- 
tunities with GAO, at the Canada 
College, Redwood City, CA, Nov. 
3. 


Spoke on the subject of GAO’s 
function in the Federal Govern- 
ment and on career opportunities 
at GAO, to the Delta Sigma Psi 
Business Fraternity, San Francis- 
co State University, Nov. 5. 


Jeff Eichner, senior evaluator, 
spoke on “Careers in the Federal 
Government” at the Career Forum 


at the Business School of the Uni- 


versity of California, Berkeley, Nov. 
18. 


Seattle 


David V. Uberuaga, evaluator, dis- 
cussed opportunities in GAO’s co- 
op program with officials of the 
Seattle University accounting 
department, Mar. 24. 


Paul E. Staley, Jr., senior evalua- 
tor, coauthored a paper on “Changes 
in Seafood Processing Technology,” 
which was presented at the summer 
meeting of the American Society of 
Agricultural Engineers, Orlando, FL, 
June 21-24. 


Charles D. Mosher, senior evalua- 
tor: 


Discussed two GAO reports, 
“Billions Could Be Saved Through 
Waivers for Coastal Waste Water 
Treatment Plants’ and “EPA 
Should Help Small Communities 
Cope with Federal Pollution Con- 
trol Requirements,” at the 17th 
American Water Resources Asso- 
ciation Conference on Waste Im- 
pact on Water, Atlanta, Oct. 6-7. 


Presented a paper on ‘Getting 


Better Data for Decisions—A 
Challenge to the Role of GAO in 
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Program Analysis,” at the Ameri- 
can Water Resource Associa- 
tion’s Symposium on Unified 
River Basin Management, Atlan- 
ta, Oct. 8. 


Served as cochairman and 
moderator of the American Water 
Resource Association, Washing- 
ton Section, conference on 
“Water Resource Implications of 
Small Hydro Power Generation,” 
Seattle, Nov. 16. 


Was elected 1982 president of the 
Washington Section, American 
Water Resources Association, 
Nov. 16. 


Stephen J. Jue, technical assis- 
tance group manager, and Sherry A. 
Davis, management assistant 
trainee, spoke on “GAO and the Co- 
operative Education Program” at a 
meeting of the Association of Black 
Business Students, University of 
Washington, Seattle, Oct. 15. 


Walter R. Eichner, evaluator, gave 
a presentation on statistical audit- 
ing, at a meeting of the Pacific 
Northwest Intergovernmental Audit 
Forum, Portland, Oct. 16. 


Janet L. George and Brent L. 
Hutchison, evaluators, spoke on 
GAO experiences and career op- 
tions, from the co-op employee’s 
perspective, at a meeting of the 
Portland State University Chapter, 
Beta Alpha Psi, Nov. 10. 


Julie A. Rachiele, technical infor- 
mation specialist, participated in a 
workshop and conducted tours of 
facilities in Victoria, British Colum- 
bia, and the Pacific Northwest, as 
part of the annual conference of the 
Federal Interagency Field Librari- 
ans, Seattle, Nov. 16-20. 


Washington 


James E. Bonnell, senior evalua- 
tor, authored an article entitled 
“‘Transit’s Growing Financial 
Crisis,” which appeared in the Octo- 
ber 1981 issue of Traffic Quarterly. 


Eric Feldman, evaluator, spoke on 
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“The Positive Experiences of Coop- 
erative Education” at a National 
Capital Association for Cooperative 
Education seminar at George Wash- 
ington University, Washington, June 
1981. 


George Gearino, assistant re- 
gional manager, participated in the 
Mid-Atlantic Intergovernmental Audit 
Forum and presented a draft position 
paper on quality control policies, 
practices, and procedures, Balti- 
more, Nov. 4-5. 


Elizabeth Nyang, technical infor- 
mation specialist: 


Conducted a presentation on 
legislative data bases at the Fed- 
eral Interagency Field Librarians’ 
Workshop, Seattle, Nov. 19. 


Authored a book entitled “The 
African Newspaper Index” which 
selectively indexes articles from 
four African newspapers. 


Ben Ritt, evaluator, spoke on “The 
Adequacy of Computer Auditing by 
Federal Internal Auditors” at the 
Northern Virginia Chapter Associa- 
tion of Government Accountants 
seminar, Springfield, VA, Apr. 21. 








Annual Awards for Articles 
Published in The GAO Review 


Cash awards are presented each year for the best articles written by GAO 
staff members and published originally in The GAO Review. The awards are 
presented during the GAO Awards Program held annually in October in 
Washington. 

One award of $500 is available to contributing staff 35 years of age or 
younger at the date of publication and another is available to staff over 35 
years of age at that date. Staff through grade GS-15 at the time they submit the 
article are eligible for these awards. 

The awards are based on recommendations of a panel of judges designated 
by the Editor. The judges will evaluate articles from the standpoint of their 
overall excellence, with particular concern for 
e originality of concept and ideas, 
degree of interest to readers, 
quality of written expression, 
evidence of individual effort expended and, 
relevance to “GAO’s mission.” 





Statement of Editorial Policy 


This publication is prepared primarily for use by the staff of the General 
Accounting Office. Except where otherwise indicated, the articles and other 
submissions generally express the views of the authors and not an Official 
position of the General Accounting Office. 

Proposals for articles should be submitted to the Editor. Staff should con- 
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